News for hackers. Stuff that matters.

A comment on An Intro to DeepSeek's Distributed File System. Parent comment

Re:An Intro to DeepSeek's Distributed File System by rthnbgrredf on Friday April 18, 2025 @02:57AM (#43725696)
> Because it's actually fairly slow.

"We were reading data at 635 GiB/s. We broke 15 million 4k random read IOPS."

Source: https://ceph.io/en/news/blog/2024/ceph-a-journey-to-1tibps/

I don't know man, I think 15M random read IOPS is actually quite fast. I've built multi million IOPS clusters in enterprise settings all on nvme in the past.

[ Parent | on HN ]
Re:An Intro to DeepSeek's Distributed File System by rfoo on Friday April 18, 2025 @07:19AM (#43726966)
> I think 15M random read IOPS is actually quite fast

680x NVMe SSDs over 68 storage servers (so 68 CPUs) for just 15M (or 25M, tuned) random read IOPS is pretty underwhelming. The use cases where 3FS (or some other custom designs) shine are more like, 200M random read IOPS with 64 servers each with 8 PCIe gen 4 NVMe SSDs (512x SSDs in total).

[ Parent | on HN ]