The benchmark were they accomplish 1025 GiB/s is for sequential reads. For random reads they do 25.5M iops or ~100 GiB/s. See last table, column "630 OSDs (3x)".
Re:Ceph: A Journey to 1 TiB/s
by magicalhippo on Saturday January 20, 2024 @05:05AM
(#39066091)
Oh wow how did I miss that table, cheers.
At least thats the number I could find. Not exactly tons of reviews on these enterprise NVMe disks...
Still, that seems like a good match to the NICs. At this scale most workloads will likely appear as random IO at the storage layer anyway.