News for hackers. Stuff that matters.
Re:Perplexity Decider v1.3: Training, eval, and use cases by deepsquirrelnet on Friday November 13, 2026 @06:14PM (#50491518)
> So your flagship model must be fastest and most accurate.

That's rarely the way anything in life works though. Do you prioritize fastest OR most accurate? That's a question that depends on context, task difficulty, etc.

You can use a 17M parameter NLI model for simple stuff and get orders of magnitude faster decisions. But the intelligence of that model will be quite a bit weaker.

In some tasks you might be talking about very small differences in accuracy between that model and a 27B parameter LLM decision model for several orders of magnitude in speed. In other tasks, the 17M might be about as good as a random guess.

There are no comments on this comment yet.