News for hackers. Stuff that matters.

A comment on LZAV – Fast In-Memory Data Compression Algorithm (In C). Parent comment

Re:LZAV – Fast In-Memory Data Compression Algorithm (In C) by someplaceguy on Thursday July 20, 2023 @01:11PM (#36803535)
> I don't know how practical it would be but an outside-of-memory data data compression algorithm would be cool.

What does "outside-of-memory" data compression algorithm mean, exactly?

> What I like so far is that lzav is a single header file

That's cool indeed.

[ Parent | on HN ]
Re:LZAV – Fast In-Memory Data Compression Algorithm (In C) by mmphosis on Thursday July 20, 2023 @01:47PM (#36804055)
> What does "outside-of-memory" data compression algorithm mean, exactly?

Not RAM or ROM. Buffered from a device: database cluster, disk blocks/files, network packets, serial port, ...

To be complete, going the other way: ..., "in-cache", or "in-register" data compression

[ Parent | on HN ]
Re:LZAV – Fast In-Memory Data Compression Algorithm (In C) by fluoridation on Thursday July 20, 2023 @03:41PM (#36805681)
>What does "outside-of-memory" data compression algorithm mean, exactly?

You keep your data structures (dictionary, Huffman tree, etc.) in storage and stream them into memory only as necessary. Same for the data being compressed. You could use an extremely large dictionary while only using a few kilobytes of memory.

[ Parent | on HN ]