Re:I built Foyer: a Rust hybrid cache that slashes S3 latency
by cowsandmilk on Saturday September 27, 2025 @05:40PM
(#45399559)
I prefer this abstraction as it is more widely supported (I’ve had to deploy to hosts that intentionally kill when you swap) and results in development assuming that the access may be at disk speed. When you rely on swap, I often see developers assuming everything is accessible at memory speed and then surprised when swap causes sudden degradation.
Re:I built Foyer: a Rust hybrid cache that slashes S3 latency
by rockwotj on Saturday September 27, 2025 @08:42PM
(#45400725)
Yeah I mean if you have a latency sensitive workload, you don’t want page faults and swapping to give hidden latency spikes - it kills your P99 latencies
Re:I built Foyer: a Rust hybrid cache that slashes S3 latency
by jitl on Saturday September 27, 2025 @09:23PM
(#45400947)
Yeah but you can pin important pages in RAM with mlock family of syscalls and friends like move_pages for explicit page management. This is what materialize does as far as I understand it.
Actually, there's already two. The other one: just read from disk (and let OS manage caches).