News for hackers. Stuff that matters.
Re:Our Smallest, Most Efficient Model: Muse Ember by doodlesdev on Monday November 09, 2026 @07:02PM (#50434219)
Interesting to notice that the best benchmarks of the model are not on Meta's own agent harness, but instead on mini-swe-agent:

   > 1. All models run at max reasoning effort. Artificial Analysis results are from Intelligence Index v5, as published November 9, 2026; cost per task uses each model's list pricing. Internal results are from Meta's evaluation suite. The Personal Superintelligence Index (PSI) is an internal composite of eight evaluations: Agents' Last Exam, AutomationBench, FocusBench, JobBench, OfficeQA Pro, GDP.pdf, GDP.xlsx and VBT. Terminal-Bench 4.0 uses each model's best published harness: mini-swe-agent (Muse Ember), Claude Code (Claude Haiku 5.5), and Codex (GPT-6 Luna). OSWorld 2.1 uses partial-credit reward; PerceptionBench is scored with tools.

There are no comments on this comment yet.