Re:BetrFS: an in-kernel file system that uses Bε trees to or...
by williamkuszmaul on Wednesday December 01, 2021 @11:45AM
(#29405794)
It seems like you may be jumping to conclusions a bit prematurely. The paper (https://www.cs.unc.edu/~porter/pubs/fast15-final.pdf) is very explicit that they start with a cold cache. They also go into detail for why they do well on grep. As I understand it (but I'm not an expert), betrfs's advantage here comes from the fact that it stores files lexicographically by their full names (and metadata), meaning that related files are stored nearby each other on disk. This gives better locality than what you would get with a standard inode structure.
Based on that, it seems like the outcomes of the tests are pretty reasonable.
Re:BetrFS: an in-kernel file system that uses Bε trees to or...
by mnw21cam on Wednesday December 01, 2021 @12:08PM
(#29406176)
I'll concede on the hot cache suggestion. Storing the files lexicographically is an interesting thing - it means that grep/find (or anything else that reads through the files/directories in order) would perform well. But this makes the test to some extent contrived to specifically run fast on this particular system.
I do agree that this kind of filesystem mechanism should give good performance benefits. But in the general case they won't be quite as fantastic as these benchmarks make out.
Re:BetrFS: an in-kernel file system that uses Bε trees to or...
by donporter on Wednesday December 01, 2021 @12:19PM
(#29406383)
Please note that the benchmark sources are also available, e.g.; https://github.com/oscarlab/betrfs/blob/master/benchmarks/mi...
I'm struggling to see how the find/grep benchmark could possibly have such a fantastic performance benefit for betrfs, given the fact that all those filesystems are effectively reading a tree or known-location structure. The only conclusion I can reach is that maybe the betrfs test had a hot cache and the others didn't. I could possibly be persuaded if betrfs keeps all its metadata in a small easily-cached part of the disc, but there are disadvantages to that too. I don't think this test is valid.