News for hackers. Stuff that matters.
Re:Perplexity Decider v1.3: Training, eval, and use cases by walls on Friday November 13, 2026 @04:02PM (#50489599)
I've found this fairly accurate: https://huggingface.co/spaces/multimodalart/jev-decision-ind...

OneJev has been pretty amazing to run locally.

Re:Perplexity Decider v1.3: Training, eval, and use cases by viccis on Friday November 13, 2026 @05:23PM (#50490879)
That's good but I would definitely appreciate one with cost to run the benchmark and cost vs accuracy breakdowns.
Re:Perplexity Decider v1.3: Training, eval, and use cases by declanjackson on Friday November 13, 2026 @05:49PM (#50491233)
Artificial Analysis has an Index which also includes Cost per Task, Time per Task, accuracy, calibration etc. here: https://artificialanalysis.ai/evaluations/artificial-analysi...

(caveat, I work at AA and helped build this Index)

Re:Perplexity Decider v1.3: Training, eval, and use cases by talloaktrees on Friday November 13, 2026 @06:07PM (#50491426)
just found this today and used it as one of the links I sent a coworker who hadn't heard of decision models yet!