News for hackers. Stuff that matters.
Re:Muse Spark: Scaling Towards Personal Superintelligence by ai5iq on Wednesday April 08, 2026 @07:43PM (#47697607)
Benchmarks miss the thing that actually matters for agentic use: how does behavior change over a multi-day horizon? A model that scores well on one-shot coding tasks can still make terrible decisions when it has persistent state and resource constraints. That's where you see the real gaps between models.
Re:Muse Spark: Scaling Towards Personal Superintelligence by andai on Thursday April 09, 2026 @08:53AM (#47703081)
Is there a benchmark for these long tasks? That kind of seems like the only number worth measuring.

(Of course at that point it involves memory and context management and so on, so you're testing the harness as well as the model.)