News for hackers. Stuff that matters.
Re:Why do LLM pelicans look like this? by yorwba on Wednesday October 14, 2026 @02:08PM (#50092209)
Yeah, temperature scales all logits equally, and there's not necessarily a single setting that would produce a diversity of outcomes for creative choices without turning into complete gibberish at naturally high-entropy positions. Ideally, the model itself would modulate its next-token distribution to be flatter when creativity is called for and peakier when it should aim for the single most likely option given the context, but even then finding the right balance might be tricky.

There are no comments on this comment yet.