News for hackers. Stuff that matters.
Re:Our Smallest, Most Efficient Model: Muse Ember by small_model on Monday November 09, 2026 @02:32PM (#50430556)
Not sure this is a good way to benchmark LLM's, no offence, but a single SVG is hardly a measure of a models capability.
Re:Our Smallest, Most Efficient Model: Muse Ember by shagie on Monday November 09, 2026 @09:38PM (#50435414)
[delayed]
Re:Our Smallest, Most Efficient Model: Muse Ember by serf on Tuesday November 10, 2026 @12:52AM (#50436586)
>Fortunately, none of the stores caught onto my grandmother's preference for blueberry pie filling.

I think that's exactly it though. When a trend develops for something, the benchmark itself becomes useless both from the social-gaming side and the corporate-trainining-aiming, just general unfairness and dishonesty all around.

and to get around that people have developed personal and private benchmark suites that reflect their own workloads, much like the proposed pie-filling-cost test.

I'd wager a guess that your grandma baked pies.