Re:Gemma 3n preview: Mobile-first AI
by mltsd on Tuesday May 20, 2025 @07:10PM
(#44046830)
I wonder how powerful the models our phones can run will be when (if?) they figure out how to make them 'specialized', i.e. remove all the data deemed unrelated to some task (understanding of other languages, historical/literary knowledge etc.), even if hardware doesn't improve much it seems there's still a lot to optimize
[ Parent
| on HN ]
Not a bad idea for next generation models, especially since the state of the art already uses Mixture of Experts.
Re:Gemma 3n preview: Mobile-first AI
by vineyardmike on Wednesday May 21, 2025 @01:34AM
(#44048571)
I generally assume this is how existing model developers have been improving. Gemini especially is crazy fast, and thanks to google search integration, Gemini-the-model doesn’t need to “know” any trivia.