RubyX (John Knight)

John gave a short presentation about the RubyX project, which is a linux distribution that uses Ruby in some manner. I’m a little unclear on exactly how Ruby is used in the project, but John is advocating that folks who are interested take a look at it and supported it.

Ruby on Windows (Dan Berger)

Dan has been using Ruby on windows and realized Ruby seriously lagged behind both Perl and Python in supporting the windows platform. Dan has been working on the win32util project on RubyForge to address that disparity. Daniel did include the disclaimer that he is not a Microsoft Employee, nor is he paid for this

Dan first talked about setting up services. I’m grabbing a lot of his example code because I have an immediate use for this.

To query about services …

  require "wind32/service"
  include Win32
  Service.services { |service| p service}
  Service.status("ClipSrc")
  Service.getdisplayname("ClipsSrv")

To control a service …

  Service.stop(name)
  Service.start(name)
  Service.pause(name)
  Service.resume(name)
  Service.delete(name)

To create a service …

  require 'win32/service"
  include Win32

  class MyDaemon < Daemon
    def service_main
      # Service code goes here
    rescue Exception => e
      logfile.puts "ERROR: #{e.message}"
      exit
    end
  end

  d = MyDaemon.new
  d.mainloop

To register a service

  serv = Service.new
  serv.create_service { |s|
    s.service_name = "aba"
    s.display_name = "aba"
    s.binary_path_name = "c:\\..."
  }

Daniel covered a number of other utils. In particular he identified a number of things that just work differently, but they are working on unifying the APIs between the two platforms. In particular, the RubyGems team is interested in the popen3 api so that our functional tests could be run on a Windows platform.

How Dynamic Can You Get? (Jamis Buck)

Jamis had the challenging task of convincing a bunch of dynamic language enthuisists that dependency injection can make their already flexible language even more flexible. While dependency injection in a huge advantage in a language like Java, there some questions to how much it adds to Ruby. Copland, a framework for Dependency Injection/Inversion of Control, is very patterned after a Java based framework. I think it would be interesting to Ruby-ize the framework and see what falls out.

Code generation with Ruby in a heterogenous network application (Gorden James Miller)

Gorden needed to get a largish C++ application running on a hardened computer network with a small memory footprint. There are a number of messages involved in the network solution. He used XML to describe the nature of the message and the structures sent with the message. Reading the XML with REXML, he used ERB to provide templates for C++ code generation to handle the messages. I found it fascinating to use ERB for code generation rather than web pages.

There are some more interesting details the type of network they are testing/simulating. The network is only up for brief periods of time and must survive as much as a 90% packet loss.

Lunch

Self-Organizing Afternoon Activities

After lunch, the afternoon was open for talking, programming or whatever else suits your fancy. Here’s some of the stuff I participated in.

• Jim Freeze and I (and later Rich Kilmer) worked up a reasonable Ruby-based domain language for Jim to use to specify some work related config files. This is one of the themes I heard over and over again during the conference.
• David Heinemeier Hansonn decided to include a "Builder style" view into Rails. If your view directory contains a ".rbuild" file, then the file will be invoked with a XML Builder object that you can use to programmatically build your html page. This is an alternative to the rhtml ERB files. Builder probably isn’t a good choice where you have a page designer involved, but it might make sense for a programmer only project, or for generating an RSS style page. David also mentioned something about doing web services with Rails. Now that would be cool.
• Finally, I worked with Chad Fowler and Bruce Williams on the design of the new RubyGems.org website. Chad had a prototype app built, and Bruce started helping him refine it Me? I kibitz-ed and watched for the most part.

Conference Summary

What a weekend! There was an energy about this conference that I hadn’t felt before. The entire community was excited about apps like Rails and the proto-Rite VM (YARV). The ability to talk to folks actually using your software and getting feedback is quite a rush. I received all kinds of good ideas and suggestions. Unfornately, my plate is already full of things to do, so who know when I will get to all these ideas.

Wow, I can’t wait till next year!

• Feedback

Narf: revisiting a 2 year old (Patrick May)

Narf (Not Another Ruby Framework) is a web framework for Ruby. Patrick introduced Narf at an earlier RubyConf. The latest Narf seems to have added a number of libraries and facilities over the past few years.

One of the really interesting points in Patrick’s presentation is how he handles vandals at his wiki site. He has created a tarpit, so that known vandals are redirected to a parallel web site that gets restored every night. The vandals believe they are modifying the real site, but no one else sees the vandals changes.

Another thing to look into is the HtmlArea library for doing rich text form editing in a browser.

ruby-doc.org: Now and the Future (James Britt)

The ruby-doc site was born at the Seattle RubyConf then James Britt and Jim Freeze talked about pulling together documentation for the Ruby community. The site has grown over the years and provides some great information. The biggest downside to the site is the difficulty finding and and navigating the information. James talked about approaches to categorizing information automatically and easily.

(an aside)

Bruce Williams has created a web site for pasting code. There is a section for RubyConf folk to share code. See codepaste.org.

By the way, codepaste is a Rails application, which leads us to …

Ruby on Rails … Origin, Driver, Destination (David Heinemeier Hansson)

David shares how he discovered Ruby and had this wonderful experience with it. Rails, in part, is an attempt to bring the joy of Ruby to the masses by providing an attractive,easy to use web framework.

If you have not seen Rails, check out the ten-minute introduction flash video at media.nextangle.com/rails/rails_setup.mov.

Hang on! There is a rails surprised promised after everybody gets their lunch food.

Lunch Break

(over the shoulder)

I’m sitting behind Rich Kilmer at the conference. I just saw him bring up a web page, pause with the mouse over the submit button and glance over at Chad. He then pressed submit. I think I just saw the first upload of Alph software to RubyForge. Let’s check this out (browses over to RubyForge). Yes, it’s there! Download Alph

The Many Facets of RubyGems (Jim Weirich

What can I say. I think it went well. You can see everything at onestepback.org/articles/rubygemsfacets.

YARV: Yet Another Ruby VM (SASADA Koichi)

Despite an obvious language barrier, Koichi did a great job of communicating with the conference crowd. He showed a great sense of humor. Furthermore, he brought greetings from Matz (who couldn’t make it this year due to the soon to be birth of his child).

YARV is Koichi’s attempt at a VM for Ruby code. If YARV is successful, it will become the Rite used for Ruby 2.0. This is really exciting to see progress in something that might become Rite.

Some properties of YARV include:

• Simple stack machinge
• Ruby C extension
• Not bytecode, but wordcode
• Use Ruby’s existing infrastructure (e.g. gc, parser, API).
• YARV traverses the AST to generate code.

Currently, there are a number of basic Ruby operations that aren’t supported (method_missing comes to mind). Over the next few months Koichi will be implementing these missing feature, and also implementing the JIT and AOT (Ahead of Time) compilers for YARV. YARV will also compile direct to C code.

We wish Koichi good luck in his goals!

"Test::Unit".downcase.sub(/::/,"/") (Nathaniel Talbott)

Nathaniel shared some insights into his understanding of the "Ruby Way" and how it has changed over the years. He has applied these insights toward building a more Rubyesque testing framework.

Stuff coming to test/unit:

• Easier to write parts of the test suites (runners, assertions, etc)
• Reloadable runners.
• Using test metadata
• Declarative test syntax (i.e. a Domain Specific Language for specifying tests).

    suite do
      setup { ... setup stuff ... }
      setup_once {  ... setup once ... }
      t do
        assert_this ...
        assert_that ...
      end
    end
  

• Inline test that exist in the same file as your code.
• The ability to put examples in your class and use them as documentation.
  • e.g. example { assert_equal 2, Adder.add(1,1) }

I’m really excited about these changes. Testing in ruby is already easy, but these changes will make it even more flexible. Cool!

Surprise Presentation (Shashank Date)

Bill Venners has contacted the Ruby community about creating a web-based zine focused on Ruby. Shashank has agreed to be the editor and he has an advisory board to help him review the submitted articles. This is just a pre-announcement, there will be something more formal around the first of the year.

(RubyConf Blackout)

Sometime during the afternoon internet access through the wireless link was lost. I can only imagine the reaction in the rest of the Ruby world as suddenly everyone at the conference went silent on the #ruby-lang IRC channel. We’re back now, but I still don’t know about the details.

Dinner … Meal supplied by Infoether

Objective-C: A Retrospective (Brad Cox)

Mr. Cox started with a review of Objective-C, some of its history and some small details of its implementation. Objective-C is used to write most of the Mac software these days.

After the Objective-C talk, Mr. Cox explored some ideas in the nature of software economics. He made the following observations.

• Hardware is made of atoms
  • Abides by physical convservation lays
  • You can buy, sell and own it
• Software is made of bits
  • Immune to physical conservation laws
  • You can’t buy, sell and own it.
• Implications
  • Copyright based compensation cannot work
  • Advertising based compensation (TV model)
  • Useright base compensation never tried.

Given the above, Mr. Cox is advocating a pay-by-use/micropayments system where some kind of accounting system tracks the number of times you call a function (string compare for example) and charges your bank account for the use. Considering that a good portion of the conference attendees are open source advocates, there was a good deal of push back on these ideas. I think I see where Mr. Cox was going, he wants to create an economic system that pumps revenue into the creation of software. Unfortunately, I’m not convinced that his approach really addresses the non-tangible nature of software that he identified earlier. Nevertheless, he provided some food for thought.

You can see some of Mr. Cox’s ideas at virtualschool.edu/mybank/

Evening Activities

After the keynote talk, a good number of attendees migrated to the hotel lobby (where they have WiFi access). I didn’t see a lot of programming, but there was a lot of conversations. I started out by catching up with David Black, and then spent some time with Shashank showing him RubyGems and talking about Rake. Shashank wants to use Rake to control distributed processes, so we experimented with spawning threads from within Rake. The next step would have tasks sending commands to Rake-like Drb servers to run jobs on remote systems. It really won’t be hard to do at all.

• Feedback

Conference Introduction

David Black did his usual "Welcome to RubyConf" thing. Sounds like one or two presenters didn’t make it, so we will be doing some creative scheduling. The new PickAxe books are here, but they won’t be handed out until this afternoon (boo hiss). Oh, well.

Teaching Ruby in a Corporate Environment (Jim Freeze)

Jim is working for an EDA company. His company has established Ruby as the "knighted" language for development in this company consisting of mainly Electrical Engineers. Jim has a 3 day course on teaching Ruby to the EEs. It is oriented toward coding neophytes. I really appreciated his examples that were targetted for particular kinds of engineers.

Ruby as Maestro (Rich Kilmer)

Rich’s talk was a last minute addition to the presentation list to make up for a missing presenter. Rich’s company used Ruby to automate a component based blackboard system running on more than 300 nodes. The active agent program is a huge distributed java program, but Ruby is used to configure, build and control the system.

Rich’s project uses one of my favorite features of Ruby … the ability to create domain specific languages for specific purposes.

  wait_for "SocietyQuiesced", 2.hours do
    do_action "StopCommunications"
    do_action "StopSociety"
  end

(an aside)

There seems to be a running commentary on IRC #ruby-lang if you want to listen in.

Lunch Break

Using and Extending Ruwiki (Austin Ziegler)

Ruwiki looks like a very promising wiki clone. I’ve considered using it for my comments page. Ruwiki is very extensible (tweakable markup, different markup engines, different storage backends, etc.).

(another aside)

Bill Kleb from Langley just asked for help getting Ruby to run on the IA64 architecture.

Tycho: A Proposed Ruby-based PIM (Hal Fulton)

Hal talks about his implementation of a Personal Information Manager inspired by Info Select (a.k.a. Tornado). Tycho looks like a rather interesting way to organize information. The executable node feature could do some really interesting things (I’m thinking of a contact list that could dial your phone for you … Ok, that’s lame, but you get the idea)

Pickaxe II

Woohoo! Time to hand out the PickAxe II books.

Hacking Ruby (Paul Brannon)

Paul shares some ideas about hacking ruby code … i.e. messing around with Ruby internals, changing the meaning of built-in functions and classes, and generally having fun.

Alph (Rich Kilmer)

         In Xanadu did Kubla Khan
      A stately pleasure dome decree
    Where Alph, the sacred river, ran
    Through caverns measureless to man
           Down to a sunless sea.

Alph is a Ruby/Flash bridge allowing you to write Ruby code to control a flash application. Now that sounds simple, but there are really "interesting" hoop Rich had to jump through to get here.

Rich always thinks big. MacroMedia’s new license scheme for the layout managers makes it impossible to use layout managers with Rich’s scheme (without paying a lot of money). So, Rich is thinking about implementing an open source component library to run on the Flash VM. (note to self: Never piss off Rich)

After Conference Activities …

The formal part of the conference was over around 9:30 and we had to vacate the meeting room so that the hotel could lock it up. A large fraction of the conference attendees drifted into the hotel lobby and claimed any spot that was near a power out to continue talking and hacking. Here’s a quick rundown on some of the mini-gatherings:

• Charlie Mills was helping Bill Kleb get Ruby compiled for the IA64 archtecture. Charlie is the fellow who helped Rich Kilmer and Chad Fowler with their DNSSD service wrapper at OSCON this year. It looked like Bill and Charlie had some success by disabling optimization on the C compiler.
• At least on person was working on their presentation for the next day.
• There was a fairly large group talking to Charles L. Perkins regarding the history of Smalltalk. Charles was involved with the early Xerox Parc Place developers and had some good inside stories about the early days of Smalltalk. Later when I dropped by it sounded as if they had moved past Smalltalk history and were discussing some of the capabilities of Prolog.
• Right next to the Smalltalk history group was another cluster of folks watching as David Heinemeier Hansson helped Jim Freeze through a tutorial on Rails. I’ve used Rails a little bit and am very impressed with the framework. When I dropped by, Jim had just got a login screen working for the demo weblog.
• Chad Fowler was helping Shashank Date work on Gemifying some of the windows tools that Shashank is planning on releasing. This is where I landed for a while. By the end of the evening, we had Shashank’s WxRuby application running as a gem.

Oh, and by the way, it looks like Genx4R is the 100th ruby app/library to be packaged as a Gem.

(More Ruby Fun tomorrow)

• Feedback

If we hit 100 before my talk tomorrow, I will add a mention of that Gem to the presentation (how about that for motivation).

• Feedback

For example, if I wish to link to http://onestepback.org on a wiki page, then I must spell the link as HTTP://onestepback.org. Otherwise the updated page will be rejected.

Since the wiki spammers currently use lower case for "http", their page updates are rejected. Now this will only work until the spammer catch on and start uppercasing the HTTP. As long as the number of sites that enforce this rule is small, it should be a while before they catch on (one hopes).

Since I have implemented this patch a week ago, I have had only one instance of spamming. Yes, the spammer used an upper case HTTP. I don’t know if that particular spammer always uses upper case, or just responded intelligently to my error message. But that hasn’t been repeated. Like I say, I’m cautiosly optimistic.

You can find the patch here:

• http://onestepback.org/packages/usemod_antispam.patch

The patch was created against version 1.0 of UseMod wiki.

By posting this, I’ve (probably) increased the number of sites using this anti-spam technique and have brought the day closer to when the spammers figure it out. Oh, well. We will worry about that when it happens.

• Feedback

One of the most important lessons I have ever learned as a software developer is to keep things simple. It’s also one of the hardest lessons to remember, because as programmers, we revel in the complex. Sometimes I am forced to reconsider designs where I let my love of complexity override my good sense for simplicity.

Revisiting Builder

However, as I was using, I discovered a rather annoying feature. If you recall, builders depended on the method_missing feature of Ruby to implement arbitrary XML tags on the fly. But, in order for code like this …

   builder.p { em("Hello World") }

to work, the em message must be sent to the builder object. Normally unadorned messages are sent to self. However, the builder object evaluated its block in a special way to hijack the value of self to point to itself.

It is really cool that we just need to mention the tag name and it automatically gets generated. But there is a downside. Suppose we replace the literal "Hello World" with a method called greet that dynamically determines the proper form of greeting. Now the code looks like this…

  builder.p { em(greet) }   # greet is a method

Now, not only em, but also greet gets sent to the builder. This is wrong, greet is a method defined on the current object, not the builder. To get around this, we must save the value of self outside the block and make it available under a different name. Perhaps like this…

  s = self
  builder.p { em(s.greet) }

As I was using builder I notice I was doing the s = self step on almost everytime I used a builder. And when I forget to use the s, I would get weird bugs in my HTML output.

Clearly I was being too clever (in my defense, I just copied the Groovy design for their builders). So I fixed the builder to use normal blocks with normal evaluation and the number of accidental bugs went way down. The greet example now reads like this under the new version of builder:

  builder.p { builder.em(greet) }

Now, since is it awkward to keep mentioning the builder name over and over, it would be nice to have a shortcut. Hence builders pass themselves as a parameter to the blocks. This gives us the opportunity to use a shorter name, but only with in the block. Again, the greet example is

  builder.p { |xml|  xml.em(greet) }

(The shorter name isn’t a big advantage here, but is a big convenience when many tags are created.)

So, it gets back to that old adage: KISS — Keep It Simple Stupid!

Postscript …

Builder is availble as a gem. Version 1.0.0 has the new, simpler interface. Because Builder is a gem, you can install both versions and use either, as long as you don’t mix their usage in a single application. To use the new version (after installing), just say

  require_gem 'builder', '~> 1.0'

This allows you to use any version greater than 1.0 but less that 2.0. To use the old interface, say …

  require_gem 'builder', '~> 0.1'

This allows any version 0.1 or later, but rejects version 1.0 and up. The ~> operator is called the Pessimistic version constraint is is helpful when versions of software have incompatible interfaces. The RubyGems wiki has more information about pessimistic version constraint and about versioning policies.

• Feedback

Builder Objects

Sometimes you get good ideas from other languages.

The basic idea is that you create a builder object and then send it messages. It responds to the messages by building up a data structure based on those messages.

Ack, it’s easy to see it in action than to describe it. For example, the following code …

  builder = Builder::XmlMarkup.new("", 2)
  puts builder.person {
    name("jim")
    phone("555-1234", "local"=>"yes")
    address("Cincinnati")
  }

will print …

  <person>
    <name>jim</name>
    <phone local="yes">555-1234</phone>
    <address>Cincinnati</address>
  </person>

So, an XML Markup object produces XML markup. Not very surprising until you think about the methods send to the builder. Where is the person method defined? Or the name method?

Actually, they are not defined anywhere. Instead we have defined a generic method_missing method and handles any undefined method and adds the name of the method to the XML markup we are building. In addition we use code blocks to capture the nested nature of the XML. The result is a very natural way to programmatically generate XML markup.

And it goes beyond just markup. If you use Bulder::XmlEvents instead of Builder::XmlMarkup, the same syntax will generate SAX-like events instead of markup. Or you can use a DOM builder to generate a DOM object tree (I haven’t implemented the DOM version, but it should be straightforward).

There are a couple of "gotchas" with this approach that you should be aware of …

• Within the builder code blocks, any method call with an implicit object target needs to be sent to our builder. To achieve this, the code blocks are evaluated with instance_eval which changes the value of self to be the builder. This is OK until you want to call a method in the calling object. Since self is no longer the calling object, you have to explicitly provide the caller. Builders make this easy by setting the +@self+ instance variable to the caller.
• What happens when you need an XML tag that has the same name as an existing method name (e.g. id )? The builder objects handle this by inheriting from BlankSlate. In addition, all the implementation methods in a builder begin with an underscore, which makes them unlikely candidates for XML tags.

Because Builder objects lack the normal methods that most objects have makes working with them rather interesting. Consider the following irb session where we create a builder object and let irb try to display it (by sending it an inspect message):

    >> x = Builder::XmlMarkup.new
    => <inspect/>
    >> x
    => <inspect/><inspect/>
    >> x.to_s
    => "<inspect/><inspect/><to_s/>"
    >> x.methods
    => "<inspect/><inspect/><to_s/><methods/>"
    >> x + 5
    => "<inspect/><inspect/><to_s/><methods/><+>5</+>"
    >> x
    => <inspect/><inspect/><to_s/><methods/><+>5</+><inspect/>

Every time we send a message to the builder it records the name of the message. In a way, the builder has become a trace object, recording all the messages send to it. Weird.

Finally, consider this last example. Suppose we have a method that uses a builder to generate an RSS feed. Here is the method in part ..

  def generate_rss(builder, a_title, a_link, items)
    builder.rss("version" => "0.91") {
      channel {
        title a_title
        link  a_link
        # ... code missing ...
        items.each do |it|
          item {
           title it.title
           link  it.link
           description it.description
          }
        end
      }
    }
  end

Now a single method (generate_rss) can generate XML markup text, a DOM tree or a series of SAX events, all depending on what kind of builder object you pass to the function. That’s slightly cool.

As I mentioned, I got this idea from the Groovy language. Groovy has some other builders as well. For example there is an Ant task builder that integrates with ant. It is a very flexible technique that really shows off the power of a dynamic language.

Note: You can find the Builder object code in the RubyGem builder-0.1.1.gem available on the RubyGem server on RubyForge.

• Feedback

This is the first hand-built RSS feed I’ve put together, so let me know if I’ve screwed something up.

By the way, the idea from the feed came from the Dave's Article at the Pragmatic Automation web site

• Feedback

A couple of themes emerged from the conference. Aspect Oriented Programming may finally be coming of age. I first heard of AOP about 4 years ago. This year, there seemed to be more substance behind the buzz. We shall see.

Another theme was the the strong belief among the speakers that although Groovy is still very much in its infancy, it has a strong possibility become very significant in the next few years. If you haven’t heard of Groovy, it is a dynamic scripting language built on top of the JVM. Unlike other JVM languages such as Jython and JRuby, Groovy is designed to work closely with Java and especially the Java libraries. A brief look at Groovy reveals a lot of similarities with Ruby. I’ll be looking at Groovy in more detail.

I’ve got a couple ideas for blog entries inspired by the conference and I’ll post them here in time.

The program agenda is looking pretty good. I’m talking about RubyGems this year (what else!). I’m especially excited to see that David Heinemeier Hansson will be there and he will be talking about Ruby on Rails which has been getting a lot of air time recently.

The Conference is relatively inexpensive (only $200 for the conference fees) and it’s a great time to meet a lot of Rubyists all at once. The conference is in the Washington DC area (Chantilly, VA), so it is accessible to a large portion of the east coast.

If you are at all interested in Ruby, I urge to to come and meet with us! You can register here.

Update!

It has just been announced that Brad Cox, the inventor of Objective-C will be giving the Keynote speech at the conference.

• Feedback