News for hackers. Stuff that matters.
Re:Reasoning Models Reason Well, Until They Don't by galaxyLogic on Friday October 31, 2025 @03:49PM (#45775980)
> Every token in a response has an element of randomness to it.

I haven't tried this, but so if you ask the LLM the exact same question again, but in a different process, will you get a different answer?

Wouldn't that mean we should mosr of the time ask the LLM each question multiple times, to see if we get a better answer next time?

A bit like asking the same question from multiple different LLMs just to be sure.

There are no comments on this comment yet.