News for hackers. Stuff that matters.
Re:I miss thinking hard by Der_Einzige on Wednesday February 04, 2026 @01:12AM (#46882105)
Yet another example of "comments that are only sort of true because high temperature sampling isn't allowed".

If you use LLMs at very high temperature with samplers which correctly keep your writing coherent (i.e. Min_p, or better like top-h, P-less decoding, etc), than "regression to the mean" literally DOES NOT HAPPEN!!!!

Re:I miss thinking hard by hnlmorg on Wednesday February 04, 2026 @03:12AM (#46882957)
Have you actually tried high temperature values for coding? Because I don’t think it’s going to do what you claim it will.

LLMs don’t “reason” the same way humans do. They follow text predictions based on statistical relevance. So raising the temperature will more likely increase the likelihood of unexecutable pseudocode than it would create a valid but more esoteric implementation of a problem.

Re:I miss thinking hard by Terr_ on Wednesday February 04, 2026 @04:17AM (#46883475)
To put it another way, a high-temperature mad-libs machine will write a very unusual story, but that isn't necessarily the same as a clever story.
Re:I miss thinking hard by balamatom on Wednesday February 04, 2026 @05:24AM (#46884016)
So why is this "temperature" not on, like, a rotary encoder?

So you can just, like, tweak it when it's working against your intent in either direction?

Re:I miss thinking hard by Terr_ on Wednesday February 04, 2026 @04:59PM (#46892415)
AFAIK there's no algorithmic reason against it, but services might not expose the controls in a convenient way, or at all.
Re:I miss thinking hard by johnnyanmac on Saturday February 07, 2026 @06:00PM (#46929166)
Because you will own nothing and like it. The incentives in this economy is not about providing the best service to customers.
Re:I miss thinking hard by bob1029 on Wednesday February 04, 2026 @04:22AM (#46883510)
High temperature seems fine for my coding uses on GPT5.2.

Code that fails to execute or compile is the default expectation for me. That's why we feed compile and runtime errors back into the model after it proposes something each time.

I'd much rather the code sometimes not work than to get stuck in infinite tool calling loops.

Re:I miss thinking hard by adevilinyc on Wednesday February 04, 2026 @01:18AM (#46882156)
How do you configure LLM température in coding agents, e.g. opencode?
Re:I miss thinking hard by kabr on Wednesday February 04, 2026 @01:39AM (#46882300)
Re:I miss thinking hard by Der_Einzige on Wednesday February 04, 2026 @12:06PM (#46888395)
Note when I said "you have to hack it in", I mean you'll need to hack in support for modern LLM samplers like min_p, which enables setting temperature up to infinity (given min_p approaching 1) while maintaining coherence.
Re:I miss thinking hard by Der_Einzige on Wednesday February 04, 2026 @01:22AM (#46882180)
You can't without hacking it! That's my point! The only places you can easily are via the API directly, or "coomer" frontends like SillyTavern, Oobabooga, etc.

Same problem with image generation (lack of support for different SDE solvers, the image version of LLM sampling) but they have different "coomer" tools, i.e. ComfyUI or Automatic1111

Re:I miss thinking hard by yoyohello13 on Wednesday February 04, 2026 @01:32AM (#46882247)
Once again, porn is where the innovation is…
Re:I miss thinking hard by dizhn on Wednesday February 04, 2026 @03:37AM (#46883163)
Please.. "Creative Writing"