Re:Our Smallest, Most Efficient Model: Muse Ember
by small_model on Monday November 09, 2026 @02:32PM
(#50430556)
Not sure this is a good way to benchmark LLM's, no offence, but a single SVG is hardly a measure of a models capability.
[ Parent
| on HN ]
Re:Our Smallest, Most Efficient Model: Muse Ember
by shagie on Monday November 09, 2026 @09:38PM
(#50435414)
[delayed]
Re:Our Smallest, Most Efficient Model: Muse Ember
by serf on Tuesday November 10, 2026 @12:52AM
(#50436586)
>Fortunately, none of the stores caught onto my grandmother's preference for blueberry pie filling.
I think that's exactly it though. When a trend develops for something, the benchmark itself becomes useless both from the social-gaming side and the corporate-trainining-aiming, just general unfairness and dishonesty all around.
and to get around that people have developed personal and private benchmark suites that reflect their own workloads, much like the proposed pie-filling-cost test.
I'd wager a guess that your grandma baked pies.