News for hackers. Stuff that matters.

A comment on Gemma 3 270M: The compact model for hyper-efficient AI. Parent comment

Re:Gemma 3 270M: The compact model for hyper-efficient AI by tucnak on Friday August 15, 2025 @11:53AM (#44913907)
> You’re saying that the knowledge gained from the other languages transfers to English?

Yes, there has been many results circa 2020 or so, that have shown this to be the case. More recently, we have observed something similar with verifiable domains (see RLVR and related results) when it comes to coding tasks, specifically.

[ Parent | on HN ]
Re:Gemma 3 270M: The compact model for hyper-efficient AI by bigmadshoe on Monday August 18, 2025 @12:09PM (#44942213)
Right, but my point is that a 270M parameter model will not be bottlenecked by the availability of data for the entire English language.
[ Parent | on HN ]