News for hackers. Stuff that matters.
Re:How Much Linear Memory Access Is Enough? by PhilipTrettner on Wednesday April 08, 2026 @09:27AM (#47689947)
I looked into this because part of our pipeline is forced to be chunked. Most advice I've seen boils down to "more contiguity = better", but without numbers, or at least not generalizable ones.

My concrete tasks will already reach peak performance before 128 kB and I couldn't find pure processing workloads that benefit significantly beyond 1 MB chunk size. Code is linked in the post, it would be nice to see results on more systems.

Re:How Much Linear Memory Access Is Enough? by twoodfin on Saturday April 11, 2026 @10:43AM (#47731089)
Your results match similar analyses of database systems I’ve seen.

64KB-128KB seems like the sweet spot.

Re:How Much Linear Memory Access Is Enough? by throwaway81523 on Sunday April 12, 2026 @01:32AM (#47736409)
Doesn't it depend what you're doing? xz data compression or some video codecs? Retrograde chess analysis (endgame tablebases)? Number Field Sieve factorization in the linear algebra phase?