News for hackers. Stuff that matters.

A comment on An Intro to DeepSeek's Distributed File System. Parent comment

Re:An Intro to DeepSeek's Distributed File System by skrtskrt on Thursday April 17, 2025 @04:35PM (#43721929)
Most of the legitimate datacenter-scale direct Ceph alternatives unfortunately are proprietary, in part because it takes so much money and human-expertise-hours to even be able to prove out that scale, they want to recoup costs and stay ahead.

Minio is absolutely not datacenter-scale and I would not expect anything in Go to really reach that point. Garbage collection is a rough thing at such enormous scale.

I bet we'll get one in Rust eventually. Maybe from Oxide computer company? Though despite doing so much OSS, they seem to be focused around their specific server rack OS, not general-purpose solutions

[ Parent | on HN ]
Re:An Intro to DeepSeek's Distributed File System by steveklabnik on Thursday April 17, 2025 @05:11PM (#43722254)
> I bet we'll get one in Rust eventually. Maybe from Oxide computer company?

Crucible is our storage service: https://github.com/oxidecomputer/crucible

RFD 60, linked in the README, contains a bit of info about Ceph, which we did evaluate: https://rfd.shared.oxide.computer/rfd/0060

[ Parent | on HN ]
Re:An Intro to DeepSeek's Distributed File System by sgarland on Friday April 18, 2025 @09:57AM (#43728146)
Fascinating! I thought you were using RAIDZ3 with some kind of clever wrapper (or just DRBD), but it’s much more complex than that.
[ Parent | on HN ]
Re:An Intro to DeepSeek's Distributed File System by steveklabnik on Friday April 18, 2025 @01:22PM (#43730055)
It's not an area I personally work on, but yeah, there's a lot going on. And there will be more in the future, for example, I believe right now we ensure data integrity ourselves, but if you're running something (like Ceph) that does that on its own, you're paying for it twice. And so giving people options like that is important. It's a pretty interesting part of the space!
[ Parent | on HN ]
Re:An Intro to DeepSeek's Distributed File System by zackangelo on Friday April 18, 2025 @09:48AM (#43728084)
The 3FS chunk engine is written in Rust.
[ Parent | on HN ]