News for hackers. Stuff that matters.

A comment on The End of Moore's Law for AI? Gemini Flash Offers a Warning. Parent comment

Re:The End of Moore's Law for AI? Gemini Flash Offers a Warning by sethkim on Thursday July 03, 2025 @02:53PM (#44458100)
Yes! Both Llama 3 and Gemma 3 have 128k context windows.
[ Parent | on HN ]
Re:The End of Moore's Law for AI? Gemini Flash Offers a Warning by ryao on Thursday July 03, 2025 @04:03PM (#44458695)
Llama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.
[ Parent | on HN ]