Did you ever use Expect to automate a complex command-line procedure, like an FTP upload? Expect is handy – and very powerful – but for Ruby projects it sure would be nice to be able to automate console apps directly from Ruby.

You may not have known it, but Ruby actually ships with a tiny Expect clone called expect.rb. Unfortunately it’s more of a proof of concept than a fully functional automation tool.

Enter Greenletters. Greenletters begins to bring some of the power of Expect to Ruby, with a simple, straightforward API. For example, here’s a scripted interaction with the classic Colossal Cave Adventure:

  require 'greenletters'

  adv = Greenletters::Process.new("adventure", :transcript => $stdout)

  # Install a handler which may be triggered at any time
  adv.on(:output, /welcome to adventure/i) do |process, match_data|
    adv < < "no\n"
  end

  puts "Starting adventure..."
  adv.start!

  # Wait for the specified pattern before proceeding
  adv.wait_for(:output, /you are standing at the end of a road/i)
  adv << "east\n"
  adv.wait_for(:output, /inside a building/i)
  adv << "quit\n"
  adv.wait_for(:output, /really want to quit/i)
  adv << "yes\n"
  adv.wait_for(:exit)
  puts "Adventure has exited."

Greenletters also ships with some simple Cucumber steps, so you can immediately start using it to specify the behavior of your command-line apps:

    Given process activity is logged to "greenletters.log"
    Given a process "adventure" from command "adventure"
    Given I reply "no" to output "Would you like instructions?" from process "adventure"
    Given I reply "yes" to output "Do you really want to quit" from process "adventure"
    When I execute the process "adventure"
    Then I should see the following output from process "adventure":
    """
    You are standing at the end of a road before a small brick building.
    Around you is a forest.  A small stream flows out of the building and
    down a gully.
    """
    When I enter "east" into process "adventure"
    Then I should see the following output from process "adventure":
    """
    You are inside a building, a well house for a large spring.
    """

Want to give it a try? Then:

gem install greenletters

And check out the examples/ directory for inspiration. Let me know what you think!

Firetower is a command-line interface to Campfire. It’s currently for Linux systems only, but there’s no reason it can’t be extended to work on OS X as well.

I created it because I needed a command-line interface to Campfire that supported the current streaming Campfire API. I also wanted a bit more flexibility than existing tools provided.

You can read all the details at the Github page, but in a nutshell Firetower provides two services:

1. A way to post messages and code snippets to Campfire from the command line; and
2. A daemon which will monitor any number of campfire rooms (in any number of accounts) and take user-configurable action when events (such as new messages) occur.

The latter service is particularly flexible: it can be used to do anything from playing a sound when someone says something in a Campfire room, to implementing IRC-style bots which monitor rooms for keywords and respond accordingly.

For instance, here’s a simple (and HIGHLY UNSAFE!) Ruby eval-bot which you could drop into ~/.firetower/firetower.conf:

receive do |session, event|
  if event['type'] == 'TextMessage' && event['body'] =~ /^!eval (.*)$/
    event.room.account.paste!(event.room.name, "Eval result:\n" + eval($1).to_s)
  end
end

Which is triggered when anyone in the room prefaces a message with “!eval”:

Patches, suggestions, and bug reports welcome!

Why does this matter? Well, say you use post '/some_callback', :some => "data" in your tests to simulate a callback from an external service like Janrain. Then you use visit '/' to simulate the user loading a page after the callback.

Any cookies set during the post will be ignored by the visit call, because like I said earlier, Capy and Rack-Test don’t share cookies. So if that callback action set up a user session, that session is now lost from the point of view of Capybara (and all the Cucumber steps that use Capybara).

Putting this out there in case anyone else runs into it and is as befuddled as I was.

So apparently the Rails router has considered the dot (“.”) to be a “separator” character along with the slash (“/”) since version 1.2. I don’t know in what context this ever seemed like a good idea, but whatever. It’s not the sort of thing that’s going to bite you every day, but when it does it will be in very weird ways. To wit:

First, a simple routes.rb.

  resources :users do
    resources :projects
  end

Fill in some typical values, and you get a path:

irb(main):009:0> app.user_projects_path("avdi")
=> "/users/avdi/projects"

Now fill in a value with a period in it, and watch it explode:

irb(main):010:0> app.user_projects_path("avdi.grimm")
ActionController::RoutingError: No route matches {
  :user_id=>"avdi.grimm", :action=>"create", :controller=>"projects"
}

:action => "create"? What?!! Who said anything about create?!

As it turns out, there is an invocation in your routes file which will fix this:

  resources :users, :constraints => { :id => /.*/ } do
    resources :projects
  end

irb(main):013:0> app.user_projects_path("avdi.grimm")
=> "/users/avdi.grimm/projects"

Now I know what you’re thinking. “That’s so obvious, why didn’t he think of that immediately?” What can I say, some days I’m slow.

• Ruby on Rails Application Development. I’ve been writing Ruby code for almost ten years, and Rails applications since 2007. Whether it’s a building a green-field app or evolving an existing application, I can add value quickly, pragmatically, and sustainably.
• Hard Problems. Do you have a problem that goes beyond the typical web application stack? Need to build a distributed service, or interface with legacy systems? Talk to me. I have experience with everything from resource-constrained embedded systems, to high performance IP networking middleware, to cloud-based distributed processing and more.
• Dispersed team facilitation. I’ve been managing and working with widely distributed teams for years. And I’ve talked with numerous distributed teams about how they do remote work effectively. If you have a distributed team or are thinking of creating one, I can help you make it work.

If you’ve ever benefited from my writing, Open Source work, or talks I’d really appreciate it if you’d help me out by by telling your friends, retweeting this post, etc. Thanks!

UPDATE: For anyone who is wondering, yes, I am still working with We Are Titans as well.

This site has been a dream of mine for a long time. I’ve worked with geographically distributed teams for a few years now, and this what I’ve observed: more and more software companies are embracing remote work, but there is no dedicated space for sharing stories, best practices, and lessons learned. Wide teams is an effort to fill this gap. I’ll be sharing what I’ve learned, but more importantly I’ll be gathering and sharing the experiences of other remote workers and leaders of distributed teams.

To kick off the knowledge sharing, I’ll be wandering the halls of RailsConf all week, microphone in hand and silly hat on my head, collecting stories from anyone who will talk to me. I’ll be looking for any and all experiences with remote work – successes, failures, and everything in between. These interviews will be published over the coming months in the form of a podcast.

If you are interested in the world of dispersed teams, I hope you’ll visit the blog, subscribe to the RSS feed, and follow the @wideteams account on Twitter. And if you’re at RailsConf and see me, please do introduce yourself!

First, some numbers: $28,080 (or the price of a brand-new top-of-the-line Prius) is the average four-year tuition at a state school as of 2010. $105,092 (or the price of owning a starter home free and clear) is the average cost of tuition at a private university. Let’s split the difference and say $67,000 is the monetary cost of a four-year degree.

EDIT: One commenter objects to the use of the median number $67,700 in this article. If you have the same problem, I invite you to replace every instance of “$67,000″ with either of the numbers cited above, or simply with the phrase “a metric fuckload of moolah”. My arguments stand regardless of which figure you use.
Now, on to the objections.

Most people won’t get the educational equivalent of four years of concentrated focus on algorithms, OO design, performance analysis, compiler design, etc. while on the job.

There are a few fallacies going into this argument.

First, I’ve spoken to dozens of developers about their college educations, and the universal consensus has been that once in the working world, they only used a fraction of what they learned in college – and then needed to learn many more things that hadn’t been on the curriculum. Let’s be charitable and say that you’ll use 10% of what you learned in school on the job. 10% of four years, that’s, let’s see, 21 weeks worth of schooling.

So what we’re really asking is whether it’s possible to get the equivalent of five months of higher education on the job. It starts to seem a little more reasonable, doesn’t it?

Second is a fallacy that I run into constantly in education discussions. It’s the idea that the time it takes to learn a new skill is constant, regardless of context. It’s exemplified by the argument “that took me six months to learn when I was in school, so if you haven’t spent six months on it, you haven’t really learned it”.

But this simply isn’t true. Graduates can (and do) come out of school with a still-hazy understanding of how Object-Oriented design applies to real-world problems. But give them three months with a team of more experienced developers writing software to manage a nationwide logistics system, and they’ll know the subject backwards and forwards. You can learn more in a week of watching an expert engineer dissect and address a problem than you can in a whole semester of lecture and canned exercises.

Finally, the implication with this objection is that while it may be possible to get educated on the job, most developers simply won’t avail themselves of the opportunity and will remain at a disorganized code-monkey state of ability.

My answer to this is simple: such developers probably wouldn’t have integrated more knowledge if they had finished a four-year program, and they don’t belong on my team or any team that wants to ship quality software. Period.

Ask any senior developer what they look for in a job candidate, and I guarantee that one of their top three attributes will be “a fast learner”. The nature of this industry is that if you want to stay on the cutting edge, you have to effectively re-learn everything you know every five years. If you can’t or won’t learn the ropes on your own initiative, chances are you’re not going to keep up when the game changes in five years. Better to get out of the game now.

Maybe you can learn most skills on the job, but what about the fundamentals of computing? A great professor can give you a solid foundation that you might miss in haphazard just-in-time learning.

The one course that I’ve seen consistently remembered as a important or even life-changing by CS grads is the introductory course based on Structure and Interpretation of Computer Programs, aka the Wizard Book. As it happens, both the book and video of the lectures by the authors are available online for free, along with much of MIT’s other courseware. Problem solved.

Which reminds me, I really need to pick up watching those videos again…

Even if it doesn’t do much for your career, college is a unique experience which grows your perspectives and knowledge of yourself.

There are any number of things you could choose to do upon graduating high school. Here are a few ideas:

• Join the Peace Corp, and do humanitarian work overseas.
• Hitchhike around the country, couch-surfing and busking on street corners with a guitar and a harmonica.
• Take a job on a farm. Sling hay bales, deliver calves, and go line-dancing on the weekends.
• Backpack across Europe.
• Go to college.

Any of these choices will expand your horizons, introduce you to new people, and teach you more about yourself. Only one of them will cost you $67,000.

The notion that college is a way to broaden your perspective early in life is absolutely true. The idea that it’s the only way is silly. It’s certainly not the cheapest way.

College is an important social experience.

We’re a little off-track now, since the question at hand is whether college is a worthwhile preparation for a programming career, not whether it will get you laid. But it’s true that this is my biggest regret in not going to a four-year school. I’m frankly envious of the college social experiences a lot of my peers had while I was working.

But if you’re making this argument, it behooves you to at least be honest about it: you’re telling a student to spend $67,000 over four years in order to socialize. Is it worth it?

Conclusion

What I hope you take away from these articles is that the decision to go to college, like any other major life decision, should be subject to a cost/benefit analysis. I’ve done the math for my particular industry, and found the argument for getting a degree wanting. On the benefit side you have a marginal amount of work preparedness, all of which could be gathered in other ways; and an increasingly irrelevant piece of paper. On the cost side you have tens of thousands either in out-of-pocket cost or student loan debt, plus four years time, salary, networking, and vital hands-on experience lost. It just doesn’t add up.

Seth Godin:

Why do colleges send millions (!) of undifferentiated pieces of junk mail to high school students [...]? Biggest reason: So the schools can reject more applicants. The more applicants they reject, the higher they rank in US News and other rankings. [...] Why bother making your education more useful if you can more easily make it appearto be more useful?[...] a degree (from one of those famous schools, with or without a football team) doesn’t translate into significantly better career opportunities, a better job or more happiness than a degree from a cheaper institution.[...] A lot of these ills are the result of uniform accreditation programs that have pushed high-cost, low-reward policies on institutions and rewarded schools that churn out young wanna-be professors instead of experiences that turn out leaders and problem-solvers.

[...]there are tons of ways to get a cheap, liberal education, one that exposes you to the world, permits you to have significant interactions with people who matter and to learn to make a difference (start here). Most of these ways, though, aren’t heavily marketed nor do they involve going to a tradition-steeped two-hundred-year old institution with a wrestling team.

Tim Cavanaugh:

Student borrowing has more than doubled since the end of the 20th century, according to the College Board, with $85 billion in loans in 2008, up from $41 billion in 1998. And as the rising rate of defaults indicates, borrowers in aggregate are not making the kind of mone–i.e. twice as much as a decade ago–they would need to pay those loans back [....] we have too much money going into an asset, not enough value coming out, a massive increase in leverage, and a large taxpayer liability for the difference. [...]The traditional university of ivied walls, lecture halls, and full-dress balls is heading for a crisis. [...] If diplomas are going to continue costing more and losing value, then at least the customers should have more choice when shopping around for them.

Giles Bowkett:

Wages have not risen since the 1970s for workers with college degrees. Wages have diminished since the 70s for workers without college degrees. However, in that same period of time, CEO pay has gone from 40 times worker pay to 500 times worker pay. What’s happening here is class distinctions growing tremendously, and in a society where class distinctions matter a great deal, the perceived value of a college degree skyrockets, even as the economic advantage that it used to give you deteriorates into nothing. In a society where social class and family background can profoundly distort economic achievement, a mark of prestige like a college degree goes way up in price, because without it, you’re just a member of the working class. (Oh noez!) Colleges are selling liferafts on a sinking ship, and that gives them a license to print money.

Dave Troy:

The unrelenting message is, “If you don’t go to college, you won’t be successful.” [...]

There’s no doubt that everyone is different; not everyone is suited for the same kind of work — thankfully. But western society has perverted that simple beautiful fact — and the questions it prompts about college education — into “Not everyone is cut out for college,” as though college was the pinnacle of achievement, and everybody else has to work on Diesel engines or be a blacksmith. Because mechanics and artists are valuable too.

That line of thinking is the most cynical, evil load of horse-shit to ever fall out of our educational system. Real-life learning is not linear. It can be cyclical and progressive and it takes side-trips, U-turns, mistakes, and apprenticeships to experience everything our humanity offers us.

The notion that a college education is a safety net that people must have in order to avoid a life of destitution, that “it makes it more likely that you will always have a job” is also utterly cynical, and uses fear to scare people into not relying on themselves. Young people should be confident and self-reliant, not told that they will fail.

I have a an admitted bias in this discussion. My only higher education experience was a few part-time semesters of community college. I started writing software full-time at age 18, when most of my peers were entering college.

For years I felt guilty about that. Everyone advised me to get back into school at my earliest opportunity. My bosses freely admitted that while I was working above my grade, they were unable to promote me because I didn’t have a degree. At one point I even enrolled in a continuing education school, and almost immediately got a massive pay raise on the mere prospect that I was going to go “legitimate” and get the piece of paper stating that I knew how to do the job I’d been performing for years. Meanwhile, I learned more about the practice of software development from books, free online resources, and hands-on experience than the college fresh-outs had learned in four years of school.

All this time my advice to aspiring developers was still to ignore my example and finish school.

Then one day I took a good long look at my career and realized that while I had an immense amount of respect for the people who were telling me to get my degree, I didn’t envy their careers in the slightest. I realized that the one thing a degree would buy me was a management-track career in the sort of organization that discriminates against employees because of a piece of paper. I also noticed that the kids who were going to school were coming out saddled with student loans that they would spend the next couple decades repaying. With the economy going down the tubes as a result of a credit crisis, this started to seem like less and less of an auspicious way to start out a career.

I realized, too, that my time was limited, and that any after-hours time I spent in classes and on homework was time I wasn’t going to be spending attending users groups, writing Open Source software, and networking. And that it was those latter activities that were measurably more likely to move my career forward in the direction I wanted it to take.

I dropped all pretense of “going back to school someday”. Instead I focused on contributing the software community, building my network of contacts, and becoming the best at my craft. The results of this strategy speak for themselves: for the past several years I have enjoyed steadily increasing job satisfaction, worked with amazing people, enjoyed community recognition, and realized my dreams of working from home, surrounded by my family.

Today my advice to a young developer who is passionate about building great software is to drop out. Spend your time learning by doing, attending your local users groups, participating in mailing lists, contributing patches to Open Source software. Don’t learn to write software and work in teams; write software, and build teams. The paid work will come to you.

Of course, this only applies if you want a career like mine. If you want to do pure CS research, stay in school. If you want to work for a larger, older organization (including Google), get that degree. And if you’re only in a CS program because you heard there’s good money in software, well, frankly you should get the hell out of this industry and find something you genuinely enjoy. There are plenty of software wage-slaves in the developing world who would be happy to do a mediocre job at a fraction of the salary you’re expecting to earn.

Of course, YMMV. Results are not guaranteed. Consult your doctor, therapist, or priest to determine if this path is right for you. Just remember that your elders are coming from a time when having a degree was actually correlated with having a better life.

On the larger question of how to improve the education situation, I agree with Dave Troy and Seth Godin that we need new models of education, not simply reform of colleges. Toward that end, signs point to apprenticeship as the most promising model to build on. I’ve been hearing of more and more forward-thinking software companies embracing apprenticeship, and I think it’s a move in the right direction.

I don’t know how applicable my path or the apprenticeship model is to fields outside of software development. Giles Bowkett is right that the accredited college system isn’t just going to fade away into irrelevance. But in true Internet fashion, I look forward to seeing alternative approaches route around the establishment entirely.

UPDATE: John Trupiano points me to a related post about the sense of entitlement that often comes along with a CS degree. I think what we’re seeing here is a generational clash: the old rules about greater education automatically conferring an elevated position simply don’t apply to this industry. Unfortunately, like light from a dead star the messages young developers get are still coming from that old, vanished world. One of my motivations in writing this article is that I’ve noticed while most people in the industry recognize this shift, few will come right out and tell aspiring programmers that they’d be better off dropping out.

In other news, there is still time to submit an entry to my Ruby Challenge! You know you’ve always wanted to implement your very own Interactive Fiction engine, and now’s your chance! All the instructions are on Github.