News for hackers. Stuff that matters.

A comment on Bcachefs Merged into the Linux 6.7 Kernel. Parent comment

Re:Bcachefs Merged into the Linux 6.7 Kernel by linsomniac on Tuesday October 31, 2023 @08:48AM (#38083981)
Working deduplication would be amazing! ZFS has deduplication, but every time I've tried it has ended in a world of pain. Maybe they've fixed it in a more recent release, but the amount of RAM required for deduplication always outstripped the amount of RAM I had available to give it (the deduplication tables have to reside in RAM).
[ Parent | on HN ]
Re:Bcachefs Merged into the Linux 6.7 Kernel by ptman on Tuesday October 31, 2023 @09:13AM (#38084316)
ZFS now has reflink support, which doesn't require lots of RAM, but isn't done automatically while writing. You need to run something like https://github.com/markfasheh/duperemove
[ Parent | on HN ]
Re:Bcachefs Merged into the Linux 6.7 Kernel by mastax on Tuesday October 31, 2023 @09:44AM (#38084711)
The deduplication tables can be put in a special vdev now, I think.
[ Parent | on HN ]