News for hackers. Stuff that matters.
Re:Gemma 3n preview: Mobile-first AI by int_19h on Wednesday May 21, 2025 @12:44AM (#44048361)
The catch is that "does as good as X" is pretty much never representative of real world performance when it comes to LLMs.

In general, all those scores are mostly useful to filter out the models that are blatantly and obviously bad. But to determine whether the model is actually good at any specific thing that you need, you'll have to evaluate them yourself to find out.

There are no comments on this comment yet.