Re:Freqfs: In-memory filesystem cache for Rust
by rkagerer on Friday October 01, 2021 @09:50PM
(#28725296)
I've always been annoyed how searching a few hundred thousand NTFS records for a filename containing some arbitrary text takes a relatively long time - even using specialized tools like FileLocator Pro which I believe directly scan low-level structures like the MFT - while I can do an equivalent search in a SQL database in milliseconds. I wish filesystems like that one had vastly more performant indexing structures for the metadata (without relying on add-on layers that defer indexing and - at least in my experience - tend to break down or be out of date or obfuscate files they think you don't care about - I'm looking at you, Windows Search).
[ Parent
| on HN ]
Re:Freqfs: In-memory filesystem cache for Rust
by RicardoLuis0 on Friday October 01, 2021 @11:39PM
(#28725746)
I've been using a free tool by voidtools tool called "Everything" for years, it provides almost-instant search on windows NTFS volumes: https://www.voidtools.com/support/everything/
Re:Freqfs: In-memory filesystem cache for Rust
by rkagerer on Saturday October 02, 2021 @01:23AM
(#28726187)
Thanks. I used it years ago but it didn't suit my needs. I haven't found an indexing tool that does.
It's the difference between synchronous indexing that's baked into the system (as in file system metadata structures and database indexes, which update at the same time your data is changed) vs. fragile add-ons that index asynchronously (which in general I find tend to be too slow to update, missing results, and prone to breaking).
Re:Freqfs: In-memory filesystem cache for Rust
by solidsnack9000 on Saturday October 02, 2021 @01:26AM
(#28726200)
The lack of structure is ultimately why writes to filesystems are comparatively fast and reliable, though.
Re:Freqfs: In-memory filesystem cache for Rust
by eximius on Saturday October 02, 2021 @12:13AM
(#28725899)
well, there is a good reason they cant do that. they dont know what the files are.
perhaps filesystems should be extensible in a way that supports indexing intelligently.
(i know you mentioned an aversion to addons)