DwarFS: A fast high compression read-only file system

Re:DwarFS: A fast high compression read-only file system by Scaevolus on Sunday November 29, 2020 @11:40AM (#25246193)

Neat! I'd like to see benchmarks for more typical squashfs payloads-- embedded root filesystems totalling under 100MB. Small docker images like alpine would be a decent proxy. The given corpus of thousands of perl versions is more appropriate for comparison against git.

[ Parent | on HN ]

Re:DwarFS: A fast high compression read-only file system by mhx77 on Sunday November 29, 2020 @12:07PM (#25246369)

Author here :)

I'll add more benchmarks, this is still WIP and so far I've mainly tried to satisfy my own needs. My intention with DwarFS wasn't to write "a better SquashFS", but to make it better in certain scenarios (huge, highly redundant data) than SquashFS. SquashFS still has the big advantage of being part of the kernel, which makes it a lot more attractive for things like root file systems.

[ Parent | on HN ]

Re:DwarFS: A fast high compression read-only file system by londons_explore on Sunday November 29, 2020 @03:48PM (#25247946)

Are there git filesystems? If so, they could be a good comparison point too - gits PACK file format is pretty magic...

[ Parent | on HN ]

Re:DwarFS: A fast high compression read-only file system by Izkata on Monday November 30, 2020 @02:41AM (#25251529)

Apparently yes: https://github.com/presslabs/gitfs

[ Parent | on HN ]

Re:DwarFS: A fast high compression read-only file system by throwmemoney on Sunday November 29, 2020 @05:11PM (#25248571)

How much does the compression of the perl repo become when compressed with

lrzip -UL9 filetarball.tar

It would be a good data point for everyone.

[ Parent | on HN ]