News for hackers. Stuff that matters.
Re:Gemini 4 Hydrogen by declanjackson on Thursday November 12, 2026 @05:49PM (#50475524)
Hi there - AA employee here. This is due to 3.8 Flash having a much lower cache hit rate compared to Gemini 4 Hydrogen
Re:Gemini 4 Hydrogen by nightshift1 on Thursday November 12, 2026 @07:05PM (#50476293)
sorry if this is a dumb question, but how is this possible? what can cause the cache hit rate to change just by changing the model?
Re:Gemini 4 Hydrogen by declanjackson on Thursday November 12, 2026 @08:16PM (#50476847)
This is based on what we measure from the API - we see different endpoints depending on how they are served can have different cache hit rates (cache hit rate is defined as the % of cacheable tokens that actually come back as cache hits)
Re:Gemini 4 Hydrogen by scott_weber on Friday November 13, 2026 @04:47AM (#50480860)
One possibility (just a guess): new arch produces a more compact cache, it becomes cost effective to hold more cache for longer.
Re:Gemini 4 Hydrogen by behnamoh on Sunday November 15, 2026 @01:54AM (#50504649)
Could you elaborate? What "compactness" are we talking about?
Re:Gemini 4 Hydrogen by gruez on Thursday November 12, 2026 @07:20PM (#50476416)
Why would cache rates differ? Does hydrogen have a longer cache period?