Perl trumps Ruby and Erlang in the Wide Finder Project

Tim Bunce points me to this post about Perl being faster than Ruby in Tim Bray's Wide Finder code competition.

The Wide Finder is at heart an Apache log analysis tool to show commonly hit pages, but for purposes of this comparison, it's analyzing 971MB. Bray explains:

It’s a classic example of the culture, born in Awk, perfected in Perl, of getting useful work done by combining regular expressions and hash tables. I want to figure out how to write an equivalent program that runs fast on modern CPUs with low clock rates but many cores; this is the Wide Finder project.

All the talk about Erlang and parallelism makes me want to get back to working through my copy of Programming Erlang. Oh tuits, come to me!

Categories

0 TrackBacks

Listed below are links to blogs that reference this entry: Perl trumps Ruby and Erlang in the Wide Finder Project.

TrackBack URL for this entry: http://perlbuzz.com/cgi-bin/mt/mt-tb.cgi/218

3 Comments

AMD is said to be working chips that would have multiple cores that all work as one, not requiring any special work by the software. Assuming that works out, perhaps none of this will matter. http://www.bit-tech.net/news/2006/04/17/amd_reverse_hyperthreading/
Perrin said:
I'm not surprised that Ruby was slow, since it's pretty well established on various benchmarks, but I am surprised Python didn't do better. Maybe that code will improve.
Max Author Profile Page said:
Wow, that's really interesting. I'm working on re-writing awstats to bring it up to the 21st century, and I was just thinking about this exact sort of problem the other day. This will be handy! :-) -Max

Leave a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)

About this Entry

This page contains a single entry by Andy Lester published on November 21, 2007 9:14 AM.

Who's doing Perl Survey analysis? was the previous entry in this blog.

Perl gratitude, 2007 is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Other Perl Sites

Other Swell Blogs

  • geek2geek: An ongoing analysis of how geeks communicate, how we fail and how to fix it.
Technorati Profile