News for hackers. Stuff that matters.
Re:Rope Science – Computer science concepts behind the Xi ed... by vardump on Monday April 17, 2017 @09:21AM (#14130676)
Would it be possible to add in-memory LZ4 compression in xi-editor? For those huge log, XML, csv, etc. files?

Maybe it'd still be possible to maintain good response time while enjoying 4-10x memory savings.

Re:Rope Science – Computer science concepts behind the Xi ed... by raphlinus on Monday April 17, 2017 @11:11AM (#14131441)
It would be possible. I'm thinking of adding "pack/unpack" operations to the Leaf data structure, but it's more motivated by getting a varint encoding for line breaks; right now each break is a 64 bit integer (on 64 bit builds), so if you have file consisting of empty lines, the corresponding line break data structure is 8 times bigger than the text. With the varint encoding I have in mind, it would be bounded at 1/4.

That said, I'm very skeptical that lz4 on text would be worth it.

Re:Rope Science – Computer science concepts behind the Xi ed... by E6300 on Monday April 17, 2017 @10:40AM (#14131182)
Wouldn't it be easier to just not load those lines?