Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by mbelshe on Friday May 06, 2011 @12:46PM
(#2521520)
The great thing and the worst thing about benchmarks is that vendors optimize to them :-)
IE9 claims speed, but the only benchmark it performs better than other browsers on is the SunSpider benchmark. If it is so fast, why does it only do well on a single benchmark? It has already been documented that trivial changes to SS make IE9's performance change dramatically: http://blog.mozilla.com/rob-sayre/2010/11/16/reporting-a-bug...
Personally, I believe SunSpider is just too-easy-to-game. Historically, this problem comes up now and then with compiler vendors and benchmarks. The only solution is to have long-running benchmarks which exercise many parts of the JS engine so that gaming is not so easy.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by kenjackson on Friday May 06, 2011 @01:33PM
(#2521702)
Actually the IE9 SS issue was a bug. It's since been fixed and no longer displays this weird behavior in IE9.
IE9 also does well on other benchmarks too like the Facebook graphics benchmark, where I think the only browser to beat it was FF4.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by mbelshe on Friday May 06, 2011 @01:44PM
(#2521751)
There were multiple issues. There was a straight up bug, which was fixed. But the perf delta remains.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by mbelshe on Friday May 06, 2011 @02:44PM
(#2521988)
You can see this for yourself - run the test referenced in Rob's post above. IE9, right now, reports a 13-14x slowdown on that test with trivial changes.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by kenjackson on Friday May 06, 2011 @02:33PM
(#2521946)
I don't believe so. I had checked this and the perf issue went away. Maybe you're referring to a different issue. Can you post a link with perf data?
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider
by andrewcooke on Thursday May 05, 2011 @04:32PM
(#2518797)
postponed gc?
I am curious though why IE gets slower. At worst it should run about the same speed.