InfoWorld's Peter Wayner has published his head-to-head Web browser battle roundup, comparing Google Chrome 10, Mozilla Firefox 4, Microsoft Internet Explorer 9, Apple Safari 5, and Opera 11.1. Given that browser speed is a crucial part of the battle -- browser makers like to tout that their latest release is the fastest on the market -- Wayner's speed tests are of particular interest.
But browser speed tests are also problematic and don't always relate much to an average user's activities.
The differing results raise methodology questions, but the deeper problem with benchmarks is that they don't always reflect typical real-world browser usage. In fact, a recent research paper examined the testing processes of SunSpider and V8 (PDF) and found that "benchmarks are not representative of many real websites and that conclusions reached from measuring the benchmarks may be misleading."
This story, "Do benchmarks really measure a browser's speed?," was originally published at InfoWorld.com. Get the first word on what the important tech news really means with the InfoWorld Tech Watch blog. For the latest developments in business technology news, follow InfoWorld.com on Twitter.