Re:Gemma 3n preview: Mobile-first AI
by int_19h on Wednesday May 21, 2025 @12:44AM
(#44048361)
The catch is that "does as good as X" is pretty much never representative of real world performance when it comes to LLMs.
In general, all those scores are mostly useful to filter out the models that are blatantly and obviously bad. But to determine whether the model is actually good at any specific thing that you need, you'll have to evaluate them yourself to find out.
In general, all those scores are mostly useful to filter out the models that are blatantly and obviously bad. But to determine whether the model is actually good at any specific thing that you need, you'll have to evaluate them yourself to find out.