News for hackers. Stuff that matters.
Re:BetrFS: an in-kernel file system that uses Bε trees to or... by derefr on Wednesday December 01, 2021 @11:11AM (#29405244)
When the limiting factor for IO perf that you’re trying to measure with your benchmark is the filesystem, rather than the disk, you don’t actually want a real disk backing your filesystem; that would just introduce noise to your measurements. Instead, you want your filesystem to be backed with an entirely in-memory block-device loopback image or some equivalent — which VMs are perfectly capable of (and in fact better at) providing.

Think of it by analogy to e.g. GPU benchmarking: you’d never use anything slower than the fastest CPU you can get your hands on, because you want to benchmark the GPU on its own as a single system bottleneck; not how well the GPU idles when held back by a bottleneck somewhere else in the system.

Re:BetrFS: an in-kernel file system that uses Bε trees to or... by MobiusHorizons on Wednesday December 01, 2021 @12:18PM (#29406358)
I don’t think you want to benchmark datastructures designed to be efficient on high latency disks using low latency memory. Many file systems can be efficient with low latency disks, that’s not very impressive. What’s impressive is being efficient with high latency storage.
Re:BetrFS: an in-kernel file system that uses Bε trees to or... by derefr on Thursday December 02, 2021 @09:12PM (#29425834)
Who said anything about low latency? The thing you get from a simulated block device is predictable, controllable latency. Latency that can be deterministically replayed. Latency that can be precisely normalized away in the benchmark results, without worrying about inter-batch anomalies (if using separate disks) or the effects of wear (on the same disk.)
Re:BetrFS: an in-kernel file system that uses Bε trees to or... by MobiusHorizons on Sunday December 05, 2021 @03:03PM (#29452569)
If it’s backed by ram, I would expect the performance characteristics to differ from ssd or hdd, especially in respect to latency concerns.