News for hackers. Stuff that matters.
Re:An Ode to Bzip by ryan14975 on Sunday March 15, 2026 @12:20AM (#47384328)
One underappreciated reason DEFLATE/gzip persists: it's streaming-friendly. You can emit compressed bytes incrementally without buffering the entire input. BWT-based algorithms (bzip2) need the whole block in memory before the transform can run.

This matters a lot for formats like ZIP, where the archive is constructed on-the-fly. You can pipe data through DEFLATE and compute CRC32 as you go, writing headers retroactively via Data Descriptors. Try that with bzip2 and you're stuck buffering 900KB blocks before you can output anything.

zstd threading and framing are a step forward here, but DEFLATE's simplicity and tiny memory footprint (~32KB window) make it hard to kill in constrained or streaming contexts.

Re:An Ode to Bzip by foltik on Sunday March 15, 2026 @05:25AM (#47385679)
LLM slop, and also incorrect.

900kb is not “buffering the entire input,” it’s just a slightly larger buffer size. Both are streaming algorithms.

Re:An Ode to Bzip by jiggawatts on Sunday March 15, 2026 @05:45AM (#47385774)
It's a bot/shill account advertising "zip as a service". I wish I was kidding.