News for hackers. Stuff that matters.
Re:Axboe Achieves 8M IOPS Per-Core with Newest Linux Optimiz... by anarazel on Monday October 18, 2021 @11:43AM (#28906672)
It's worth noting that there's some batching involved, so it's not 125ns for processing one io, then again 125ns for the next. Both combining some of the work, and superscalar execution is necessary to reach this high numbers...
Re:Axboe Achieves 8M IOPS Per-Core with Newest Linux Optimiz... by benlwalker on Monday October 18, 2021 @12:43PM (#28907554)
To expand on the batching details, I haven't seen exactly what he's doing here, but historically the numbers quoted are from benchmarks that submit something like 128 total queue depth in alternating batches of 64. The disks hit max performance with a much lower queue depth than 64. So it's very unrealistic perfect batching that you'll never see in a real application. The workload is only a useful tool for optimizing the code, which is exactly what he's using it for.
Re:Axboe Achieves 8M IOPS Per-Core with Newest Linux Optimiz... by wtallis on Monday October 18, 2021 @12:54PM (#28907684)
The Intel Optane drives he's testing with hit max performance at pretty low queue depths, but flash-based SSDs with similar throughput will require those high queue depths.
Re:Axboe Achieves 8M IOPS Per-Core with Newest Linux Optimiz... by anarazel on Monday October 18, 2021 @02:11PM (#28908948)
I think you need batching for the nvme doorbell alone at anything close to these kinds of rates...

For some workloads it's not that hard to have that deep queues. What's harder is to know when to use them and when not. There's really not enough information available to make any of this self-tuning.