News for hackers. Stuff that matters.

A comment on The Evolution of Caching Libraries in Go and Ristretto's zero hit rate mystery.

Re:The Evolution of Caching Libraries in Go and Ristretto's ... by yumenoandy on Wednesday July 02, 2025 @05:03PM (#44448809)
on S3-FIFO being problematic, have you looked into TinyUFO? (part of cloudflare/pingora)
[ Parent | on HN ]
Re:The Evolution of Caching Libraries in Go and Ristretto's ... by maypok86 on Wednesday July 02, 2025 @05:31PM (#44449070)
No, I haven't looked into it, but the combination of "lock-free" and "S3-FIFO" raises some red flags for me :)

I don't quite understand the specific rationale for replacing segmented LRU with S3-FIFO. If I remember correctly, even the original authors stated it doesn't provide significant benefits [1].

Regarding TinyUFO - are you using lock-free queues? Has the algorithmic complexity of TinyLFU changed? (In the base version, S3-FIFO is O(n)). How easy is it to add new features? With lock-free queues, even implementing a decent expiration policy becomes a major challenge.

[1]: https://github.com/Yiling-J/theine/issues/21

[ Parent | on HN ]