News for hackers. Stuff that matters.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by kenjackson on Thursday May 05, 2011 @12:51PM (#2518029)
Yes, running a benchmark that doesn't test the right things 50x more doesn't really fix the core issue.

I am curious though why IE gets slower. At worst it should run about the same speed.

Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by mbelshe on Friday May 06, 2011 @12:46PM (#2521520)
The great thing and the worst thing about benchmarks is that vendors optimize to them :-)

IE9 claims speed, but the only benchmark it performs better than other browsers on is the SunSpider benchmark. If it is so fast, why does it only do well on a single benchmark? It has already been documented that trivial changes to SS make IE9's performance change dramatically: http://blog.mozilla.com/rob-sayre/2010/11/16/reporting-a-bug...

Personally, I believe SunSpider is just too-easy-to-game. Historically, this problem comes up now and then with compiler vendors and benchmarks. The only solution is to have long-running benchmarks which exercise many parts of the JS engine so that gaming is not so easy.

Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by kenjackson on Friday May 06, 2011 @01:33PM (#2521702)
Actually the IE9 SS issue was a bug. It's since been fixed and no longer displays this weird behavior in IE9.

IE9 also does well on other benchmarks too like the Facebook graphics benchmark, where I think the only browser to beat it was FF4.

Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by mbelshe on Friday May 06, 2011 @01:44PM (#2521751)
There were multiple issues. There was a straight up bug, which was fixed. But the perf delta remains.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by mbelshe on Friday May 06, 2011 @02:44PM (#2521988)
You can see this for yourself - run the test referenced in Rob's post above. IE9, right now, reports a 13-14x slowdown on that test with trivial changes.
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by kenjackson on Friday May 06, 2011 @02:33PM (#2521946)
I don't believe so. I had checked this and the perf issue went away. Maybe you're referring to a different issue. Can you post a link with perf data?
Re:Google Criticizes JavaScript Benchmarks, Modifies Sunspider by andrewcooke on Thursday May 05, 2011 @04:32PM (#2518797)
postponed gc?