News for hackers. Stuff that matters.
Re:Beyond malloc efficiency to fleet efficiency by dragontamer on Monday July 19, 2021 @10:38PM (#27889545)
> As an example of the benefits of this approach, one service increased its time in TCMalloc from 2.7% to 3.5%, an apparent regression, but reaped improvements of 3.4% more requests-per-second, a 1.7% latency reduction, and a 6.5% reduction in peak memory usage!

This is the stuff of performance nightmares. Anyone thinking about optimization often will get single-tracked into the performance regression there and maybe not necessarily see the improved overall performance (requests per second).

Re:Beyond malloc efficiency to fleet efficiency by rhooke on Tuesday July 20, 2021 @03:08AM (#27890844)
Agreed. Microbenchmarking can be detrimental if you don't verify with some 'macro' benchmarking with realistic use cases.

And tracking the right metrics!

Re:Beyond malloc efficiency to fleet efficiency by romesmoke on Tuesday July 20, 2021 @07:01AM (#27892245)
> In Google’s data centers, this improvement reduced TLB stalls by 6% and memory fragmentation by 26%.

Yet after Ctr+F-ing the paper for the term, I have yet to find an accurate definition of "fragmentation". Keeping in mind that fragmentation is an allocator's major enemy, it bugs me to realize that there is no universally agreed-upon formulation yet.

Does anyone more knowledgeable have a more informed opinion on the matter?

Re:Beyond malloc efficiency to fleet efficiency by PoignardAzur on Tuesday July 20, 2021 @08:01AM (#27892694)
Seems like a bit of a tragedy of the commons. Individual containers benefit from a faster malloc, but the whole fleet benefits from one doing more work.