News for hackers. Stuff that matters.

A comment on Gemma 3 270M: The compact model for hyper-efficient AI.

Re:Gemma 3 270M: The compact model for hyper-efficient AI by unleaded on Friday August 15, 2025 @04:12AM (#44909792)
ITT nobody remembers gpt2 anymore and that makes me sad
[ Parent | on HN ]
Re:Gemma 3 270M: The compact model for hyper-efficient AI by GaggiX on Friday August 15, 2025 @04:20AM (#44909839)
This model was trained on 6T tokens and has 256k embeddings, quite different than a gpt2 model comparable in size.
[ Parent | on HN ]