News for hackers. Stuff that matters.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by thegeomaster on Thursday August 14, 2025 @04:41PM (#44905463)
Well, Gemini Flash Lite is at least one, or likely two orders of magnitude larger than this model.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by dismalaf on Thursday August 14, 2025 @05:28PM (#44905914)
That's fair but one can dream of being able to simply run a useful LLM on CPU on your own server to simplify your app and save costs...