News for hackers. Stuff that matters.
Re:Generational Garbage Collection in Firefox by pselbert on Thursday September 25, 2014 @05:34PM (#8369855)
# Firefox

Sunspider: 182.5ms +/- 4.6% Octane: 21148

# Chrome Sunspider: 206.7ms +/- 1.2% Octane: 24921

I adore Mozilla and use Firefox as my primary browser. As a web developer I hope those benchmarks get tighter.

Re:Generational Garbage Collection in Firefox by nnethercote on Thursday September 25, 2014 @10:25PM (#8371018)
Sunspider is an ancient, awful benchmark suite that has been optimized to the point of insanity. For example, every major browser has a daylight savings offset cache that is no use to any real code but speeds up Sunspider significantly. It needs to die. You should ignore it.

Octane is better, though still flawed: https://blog.mozilla.org/nnethercote/2012/08/24/octane-minus....

The state of browser benchmarking isn't good. Here are my ideas on how to fix it: https://blog.mozilla.org/nnethercote/2014/06/16/a-browser-be.... The political/organizational challenges are as big or bigger than the technical challenges.

And really, you should care most about how each browser performs on the workloads you are interested in.

Re:Generational Garbage Collection in Firefox by aidenn0 on Friday September 26, 2014 @03:10AM (#8371670)
> The state of browser benchmarking isn't good.

You can delete the word "browser" from that sentence and it's still true. Just one example: You wouldn't believe how many large projects rely on Dhrystone for benchmarking and selecting silicon.

Re:Generational Garbage Collection in Firefox by nnethercote on Friday September 26, 2014 @06:08AM (#8372058)
I can believe it. But at least in the C/C++/Fortran world there are decent suites, e.g. SPEC, even if not everybody uses them. The browser world doesn't even have that.
Re:Generational Garbage Collection in Firefox by cromwellian on Friday September 26, 2014 @04:44AM (#8371882)
I think the brouhaha over Mandreel vs Emscripten glosses over a deeper issue, which is, the vast majority of Web apps aren't C++ compiled to asmjs, and performance on asmjs is not going to be a good proxy for general web performance.

"Real apps" using idiomatic JS should be used as benchmarks, and those apps should approximate apps in widespread deployment. For example, how fast can a reactjs re-render for a complex page run?

Re:Generational Garbage Collection in Firefox by pcwalton on Thursday September 25, 2014 @05:37PM (#8369871)
Use http://arewefastyet.com/ for the most recent benchmarks. The results on there are rather different from what you quoted.
Re:Generational Garbage Collection in Firefox by rcthompson on Thursday September 25, 2014 @06:00PM (#8370005)
Should GGC have a major impact on overall execution time? Or is it more about reducing "jank", or whatever they're calling it these days?
Re:Generational Garbage Collection in Firefox by sphink on Thursday September 25, 2014 @06:08PM (#8370049)
It has some impact on overall execution time (throughput), mostly through being able to bump allocate. The benchmark I used in the article shows a large gain, though the real-world effect is much less.

But GGC is mostly about reducing pause times (latency). (And yes, people have taken to calling that "jank". I still resist the term when I can, since it's no more precise than anything that came before but people seem to think it must mean something specific.)