News for hackers. Stuff that matters.
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview by stymaar on Sunday August 30, 2026 @11:50AM (#49499774)
I don't think this argument is a good one though, as it would be quite natural for a lab rhat want to macimize the performance of their model on the pelican bench to train it for “text-to-svg simple image generation” rather than just “pelicans on bicycle”.
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview by Anon1096 on Sunday August 30, 2026 @01:51PM (#49501018)
That is the point though, if labs are maximizing svg image generation capabilities it is a very good thing. That's a general skill that is useful. So assuming they aren't specifically maximizing pelican bicycle svgs (and it doesn't look like they are) then incentives are aligned that the "benchmark" is measuring a general desirable capability.
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview by flexagoon on Sunday August 30, 2026 @04:57PM (#49502725)
Re:Tencent Releases and Open-Sources Tencent Hy4 Preview by simonw on Sunday August 30, 2026 @08:19PM (#49504238)
Gemini have done exactly that.

(I doubt it's because of my stupid benchmark, though!)