News for hackers. Stuff that matters.
Re:Microsoft AI: Seven new world-class models at scalable pr... by seizethecheese on Wednesday November 18, 2026 @01:23PM (#50550023)
[delayed]
Re:Microsoft AI: Seven new world-class models at scalable pr... by danielmarkbruce on Wednesday November 18, 2026 @01:34PM (#50550189)
Definitely. Cost per task is nice in theory, pretty absurd in practice.
Re:Microsoft AI: Seven new world-class models at scalable pr... by seizethecheese on Wednesday November 18, 2026 @01:41PM (#50550303)
Well, it depends on the data source. Cost per task for benchmarks is absurd. Cost per task for real world usage, where the model identity is randomized (Like Arena or Agent Duel) seems better, though the tasks still are not going to be representative if you're not doing the same stuff as the battle participants.