News for hackers. Stuff that matters.
Re:Recent AI model progress feels mostly like bullshit by NiloCK on Monday April 07, 2025 @07:52AM (#43610236)
I'm not generally inclined toward the "they are cheating cheaters" mindset, but I'll point out that fine tuning is not the same as retraining. It can be done cheaply and quickly.

Models getting 5X better at things all the time is at least as easy to interpret as evidence of task-specific tuning than as breakthroughs in general ability, especially when the 'things being improved on' are published evals with history.

Re:Recent AI model progress feels mostly like bullshit by alphabetting on Monday April 07, 2025 @08:03AM (#43610319)
Google team said it was outside the training window fwiw

https://x.com/jack_w_rae/status/1907454713563426883