News for hackers. Stuff that matters.
Re:JuiceFS is a distributed POSIX file system built on top o... by eerikkivistik on Friday January 16, 2026 @03:31AM (#46644344)
I've had to test out various networked filesystems this year for a few use cases (satellite/geo) on a multi petabyte scale. Some of my thoughts:

* JuiceFS - Works well, for high performance it has limited use cases where privacy concerns matter. There is the open source version, which is slower. The metadata backend selection really matters if you are tuning for latency.

* Lustre - Heavily optimised for latency. Gets very expensive if you need more bandwidth, as it is tiered and tied to volume sizes. Managed solutions available pretty much everywhere.

* EFS - Surprisingly good these days, still insanely expensive. Useful for small amounts of data (few terabytes).

* FlexFS - An interesting beast. It murders on bandwidth/cost. But slightly loses on latency sensitive operations. Great if you have petabyte scale data and need to parallel process it. But struggles when you have tooling that does many small unbuffered writes.

Re:JuiceFS is a distributed POSIX file system built on top o... by mickael-kerjean on Friday January 16, 2026 @03:52AM (#46644464)
Nothing around content addressable storage? Has anyone used something like IPFS / Kubo in production at that kind of scale?

(for those who don't know IPFS, I find the original paper fascinating: https://arxiv.org/pdf/1407.3561)

Re:JuiceFS is a distributed POSIX file system built on top o... by eerikkivistik on Friday January 16, 2026 @07:47AM (#46645874)
The latency and bandwidth really isn't there for HPC.
Re:JuiceFS is a distributed POSIX file system built on top o... by romantomjak on Friday January 16, 2026 @04:53AM (#46644810)
Did you happen to look into CephFS? CERN (folks that operate Large Hadron Collider) use it to store ~30PB of scientific data. Their analysis cluster is serving ~30GB/s reads
Re:JuiceFS is a distributed POSIX file system built on top o... by eerikkivistik on Friday January 16, 2026 @07:47AM (#46645868)
Sure, so the use case I have requires elastic storage and elastic compute. So CephFS really isn't a good fit in the cloud environment for that case. It would get prohibitively expensive.
Re:JuiceFS is a distributed POSIX file system built on top o... by yencabulator on Monday January 19, 2026 @03:35PM (#46684146)
Ceph is more something you build your own cloud with than something you run on someone else's cloud.