Re:Perplexity Decider v1.3: Training, eval, and use cases
by jstummbillig on Friday November 13, 2026 @04:00PM
(#50489579)
Any ideas what decider models are actually good? There does not seem to be a strong competitive benchmark culture (as with LLMs) for whatever reason?
[ Parent
| on HN ]
Re:Perplexity Decider v1.3: Training, eval, and use cases
by walls on Friday November 13, 2026 @04:02PM
(#50489599)
I've found this fairly accurate: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
OneJev has been pretty amazing to run locally.
Re:Perplexity Decider v1.3: Training, eval, and use cases
by viccis on Friday November 13, 2026 @05:23PM
(#50490879)
That's good but I would definitely appreciate one with cost to run the benchmark and cost vs accuracy breakdowns.
Re:Perplexity Decider v1.3: Training, eval, and use cases
by declanjackson on Friday November 13, 2026 @05:49PM
(#50491233)
Artificial Analysis has an Index which also includes Cost per Task, Time per Task, accuracy, calibration etc. here: https://artificialanalysis.ai/evaluations/artificial-analysi...
(caveat, I work at AA and helped build this Index)
Re:Perplexity Decider v1.3: Training, eval, and use cases
by talloaktrees on Friday November 13, 2026 @06:07PM
(#50491426)
just found this today and used it as one of the links I sent a coworker who hadn't heard of decision models yet!