Re:LCFS: A New Container Filesystem for Modern Datacenters
by jjobi on Friday February 03, 2017 @08:10AM
(#13559528)
Again, the focus of this blog is not about a de-duplication story, but about a new docker storage driver.
Re:LCFS: A New Container Filesystem for Modern Datacenters
by LeoPanthera on Friday February 03, 2017 @05:39PM
(#13563970)
Well thankfully open discussion is a feature of Hacker News, not a bug.
Re:LCFS: A New Container Filesystem for Modern Datacenters
by Skunkleton on Thursday February 02, 2017 @07:59PM
(#13556691)
There are patches to BTRFS (actively developed) for inband dedup as well.
Re:LCFS: A New Container Filesystem for Modern Datacenters
by jjobi on Friday February 03, 2017 @08:13AM
(#13559547)
BTRFS has so many drawbacks using it as storage driver for docker. See the bottom of the page https://docs.docker.com/engine/userguide/storagedriver/btrfs....
Primary drawback being each container creates unique copy of the data in kernel page cache and taking away system resources from applications.
ZFS's dedup uses grotesque amounts of RAM since it insists on holding the dedup table in it and only doing dedup in realtime.
btrfs however allows you to scan the filesystem and do dedup of existing data later (even while it is mounted), using no RAM at all. This is one of a couple of places where I think btrfs is actually becoming a better-designed filesystem than ZFS.