News for hackers. Stuff that matters.
Re:High-performance read-through cache for object storage by onethumb on Saturday September 20, 2025 @03:07AM (#45311154)
This looks super interesting for single-AZ systems (which are useful, and have their place).

But I can't find anything to support the use case for highly available (multi-AZ), scalable, production infrastructure. Specifically, a unified and consistent cache across geos (AZs in the AWS case, since this seems to be targeted at S3).

Without it, you're increasing costs somewhere in your organization - cross-AZ networking costs, increased cache sizes in each AZ to be available, increased compute and cache coherency costs across AZs to ensure the caches are always in sync, etc etc.

Any insight from the authors on how they handle these issue on their production systems at scale?

Re:High-performance read-through cache for object storage by trueismywork on Saturday September 20, 2025 @04:12AM (#45311444)
Not the author but. Its a user side read through cache, so no need for pre-emptive cache coherence as such. But there will be a performance penalty for fetching data under write contention irrespective of whether you have single az/multiple AZ. The only way to mitigate the performance penalty here is to have accurate predictive fetching which works for usage patterns.
Re:High-performance read-through cache for object storage by jimbohn on Saturday September 20, 2025 @04:06AM (#45311421)
Assuming the "Designed for caching immutable blobs", I guess the approach is to indeed increase the cache size in each AZ or eat the cross-AZ networking costs.
Re:High-performance read-through cache for object storage by shikhar on Saturday September 20, 2025 @08:10AM (#45312643)
Yes, that's how we are running it at s2.dev, auto-scaled per-AZ deployments. https://www.reddit.com/r/databasedevelopment/comments/1nh1go...
Re:High-performance read-through cache for object storage by immibis on Sunday September 21, 2025 @08:35AM (#45322153)
Not the author, but my suggestion is to use a real infrastructure provider. You will save tons of money.