News for hackers. Stuff that matters.

A comment on What's the strongest AI model you can train on a laptop in five minutes?. Parent comment

Re:What's the strongest AI model you can train on a laptop i... by jph00 on Thursday August 14, 2025 @04:51PM (#44905569)
That's not widely true. E.g the GPT 4 tech report pointed out nearly all their experiments were done on models 1000x smaller than the final model.
[ Parent | on HN ]
Re:What's the strongest AI model you can train on a laptop i... by tmule on Thursday August 14, 2025 @08:46PM (#44907445)
Fair point, though I’d argue that there’s inherent selection bias for improvements that could fit a scaling law curve in the small model regime here.
[ Parent | on HN ]