CPAN Testers considered useful


By Sébastien Aperghis-Tramoni

The CPAN Testers platform has grown up so much in the recent months that some module authors began to publicly badmouth it or some of its maintainers, because they received more FAIL reports than previously. The situation lightened a little with the recent introduction of Barbie's "CPAN Testers Daily Report". This probably still won't be enough and some authors will still be angry. But keep in mind that for one angry author, there are plenty of happy authors.

One of them is Ton Voon, maintainer of the Nagios::Plugin module. He recently posted on the Nagios plugins blog to recount how the CPAN Testers were very useful to him for spotting a hard-to-find bug, which only occurs when the test is ran with Test::More 0.86. This is typically something very hard to find for the maintainer of a module, because he naturally searches the bug in his own code, not in the modules he uses. Especially when the module is as trusted and tested as Test::More.

This is exactly what CPAN Testers offer: a platform for testing code on more operating systems than the average developer has access to, with more variations of Perl versions than the average sysadmin is willing to install. This is a very good argument to convince co-worker to contribute generic Perl code from $work (or free software written in Perl) on the CPAN: they benefit from a testing platform that they couldn't create at $work, and the Perl users benefit with more useful code. Everybody's winning. And when trying to convince them, there isn't a better way than a tool that graphically summarise the reports as Slaven Rezic's CPAN Testers Matrix does. It sure needs some polishing (and a shorter URL!), but this tool is extremely useful when a module author has to crawl through too many reports.

I think I can speak for Ton Voon and all the happy module authors: to all the CPAN Testers, thank you. We value your reports, you are useful to us.

Sébastien Aperghis-Tramoni is a system administrator and Perl expert at France Telecom Orange, in France, and maintains several CPAN modules. At Orange, Perl is the language of choice for writing all the backend and monitoring programs that make the stuff work.


Just comes to show that dedicated testers are needed in any part of testing phases. I agree to they need a shorter url and a touch up on the design wouldn't hurt...

I'm glad to have CPAN Testers too, but I've criticized it heavily in recent months for very different reasons than "receiving more FAIL reports". That's a very unfair characterization of very real problems which the CPAN Testers maintainers acknowledged and addressed.

Without knowing what issues chromatic is alluding to, I just want to say I'm generally very happy with the test reports. The fact that within 24 hours of posting an upload to PAUSE I get reports that have lead to fixes in the next release is very helpful.

The CPAN Testers platform is a great progress, congrats

Leave a comment

Job hunting for programmers

Land the Tech Job You Love, Andy Lester's guide to job hunting for programmers and other technical professionals, is available in PDF, ePub and .mobi formats, all DRM-free, as well as good old-fashioned paper.