Let’s sing along with Senator Conroy! You’ve got to accentuate the positive / Eliminate the negative / Latch on to the affirmative…

Yesterday our Minister for Broadband was “encouraged” that lab tests of ISP-level internet filters showed “significant progress” since 2005, and The Australian had him declaring the trial a success. But if you actually dig into the full report, things aren’t so rosy.

Yes, on average filters might be more accurate than three years ago and have less impact on internet speeds — well, at least for the six filters actually tested of the 26 put forward. But it’s about them being not quite as cr-p as before.

The report pre-judges the results, saying filters show “high levels of successful blocking”. But even with “most” filters achieving over 92% success, that still means 1 in 13 naughty sites are not blocked.

Similarly, the “low levels” of overblocking (incorrectly blocking legitimate content) are, at best, still 1%. With more than a million registered domain names in Australia (a loose measure of “sites”) even a 1% false positive rate means 10,000 perfectly acceptable websites are blocked. That’s with the best product. Under ideal lab conditions. The least successful of the products tested was eight times worse.

One product only degraded internet speeds by 2%, maybe, but it was 22% to 30% for three products, and more than 75% for two of them. That’s up to 75% off your internet speed, or your ISP having to build 75% more capacity — with the cost passed on to you.

This was, remember, in a test lab. Filters were tested against a pre-compiled list of fewer than 4000 web pages (URLs). How they handle the massive, rapidly-changing real internet, and how that affects performance of a real ISP, are different questions.

As the report notes, ACMA wasn’t asked to look at the balance of costs and benefits for ISP-level filtering, or the implications for customers, or how easy it is to circumvent the filters (“Very easy,” some reckon).

And here’s the killer. None of the products could effectively filter instant messaging, streaming video, peer-to-peer file sharing like BitTorrent, newsgroups or newly-invented internet protocols except by blocking them entirely. Let’s count them again. None.

As the report notes, “Where such protocols are used to carry legitimate traffic and are widely used by children for study and social interaction, ACMA regards the absence of a more targeted capability as a deficiency.” Vendors mentioned development efforts but, writes ACMA, “Such capabilities may become available in the next few years.” Yeah, maybe. Until then, kids, go for it.

Hit it, Bing! You’ve got to accentuate the positive…