Re:Why do LLM pelicans look like this?
by vunderba on Wednesday October 14, 2026 @01:47PM
(#50091819)
You can try it out with local models like Gemma or Qwen (crank up temperature and/or top_p as much as you like), and then run dozens of generic independent prompts asking for a "fantasy short story". In my experience, you'll start seeing immediate patterns of repetition.
[ Parent
| on HN ]
Yeah, temperature scales all logits equally, and there's not necessarily a single setting that would produce a diversity of outcomes for creative choices without turning into complete gibberish at naturally high-entropy positions. Ideally, the model itself would modulate its next-token distribution to be flatter when creativity is called for and peakier when it should aim for the single most likely option given the context, but even then finding the right balance might be tricky.