News for hackers. Stuff that matters.
Re:Kimi K3 is now live by ruszki on Friday July 17, 2026 @06:05AM (#48945411)
Probably it was added to the training data on the first day when this benchmark was on HN main page. It’s a bad benchmark since then. I don’t know why people still rate it high. Basically, every benchmark becomes pointless after it was published. They are good only to have a picture at the time they’re published first, and not after.
Re:Kimi K3 is now live by simonw on Friday July 17, 2026 @08:29AM (#48946563)
If it was added to the training data on day one, why can't any of the models draw a decent picture of a pelican riding a bicycle?
Re:Kimi K3 is now live by ruszki on Friday July 17, 2026 @10:41AM (#48947967)
Most of them were completely unrecognizable back then. Compared to those, this is a huge achievement.