What happens behind the scenes when we change effort for same LLM models?

Re:What happens behind the scenes when we change effort for ... by OKRainbowKid on Saturday July 25, 2026 @12:45PM (#49049132)

So are you saying that effort level isn't a parameter to an LLM, but that each level actually corresponds to a slightly differently tuned LLM?

[ Parent | on HN ]

Re:What happens behind the scenes when we change effort for ... by bossyTeacher on Saturday July 25, 2026 @04:49PM (#49051420)

I think the analogy here is time. Especifically performance time. Head chef performs slower. High effort is longer inference time. For LLMs, the ability to think in more detail requires more time. Maybe this will change in the future but it is the present now.

[ Parent | on HN ]