Re:Craziest thing I ever used SQLite for: partial file dedup...
by JackSlateur on Sunday March 26, 2023 @03:11PM
(#35318308)
Looks like https://github.com/markfasheh/duperemove
[ Parent
| on HN ]
Re:Craziest thing I ever used SQLite for: partial file dedup...
by philsnow on Sunday March 26, 2023 @05:14PM
(#35319708)
Oh, hey Mark
(Not (purely) a reference to the “oh hey Mark” meme, I’m vaguely acquainted with Mark from LUG days)
Re:Craziest thing I ever used SQLite for: partial file dedup...
by tgp on Sunday March 26, 2023 @10:14PM
(#35322127)
The other day I found out that not only ZFS and Btrfs have a dedup feature, but also XFS (which I use on my home partition) supports a feature called reflinks aka block sharing. So I threw duperemove at ~/.virtualenvs and ~/.cache/bazel and freed up a good 15GB of disk space. Good stuff.