Re:Gemini 4 Hydrogen
by nightshift1 on Thursday November 12, 2026 @07:05PM
(#50476293)
sorry if this is a dumb question, but how is this possible? what can cause the cache hit rate to change just by changing the model?
[ Parent
| on HN ]
Re:Gemini 4 Hydrogen
by declanjackson on Thursday November 12, 2026 @08:16PM
(#50476847)
This is based on what we measure from the API - we see different endpoints depending on how they are served can have different cache hit rates (cache hit rate is defined as the % of cacheable tokens that actually come back as cache hits)
Re:Gemini 4 Hydrogen
by scott_weber on Friday November 13, 2026 @04:47AM
(#50480860)
One possibility (just a guess): new arch produces a more compact cache, it becomes cost effective to hold more cache for longer.