Are LLMs Random?

Re:Are LLMs Random? by sgk284 on Wednesday April 30, 2025 @05:31AM (#43842926)

Fun post! Back during the holidays we wrote one where we abused temperature AND structured output to approximate a random selection: https://bits.logic.inc/p/all-i-want-for-christmas-is-a-rando...

[ Parent | on HN ]

Re:Are LLMs Random? by onionisafruit on Wednesday April 30, 2025 @08:40AM (#43844369)

I enjoyed that.

When you asked it to choose by picking a random number between 1 and 4, it skewed the results heavily to 2 and 3. It could have interpreted your instructions to mean literally between 1 and 4 (not inclusive).

[ Parent | on HN ]

Re:Are LLMs Random? by sgk284 on Friday May 02, 2025 @04:46AM (#43867529)

Yea, absolutely. That's a good point. We could have phrased that more clearly.

[ Parent | on HN ]

Re:Are LLMs Random? by LourensT on Wednesday April 30, 2025 @09:14AM (#43844796)

could you use structured output to make a more efficient estimator for the logits based?

[ Parent | on HN ]

Re:Are LLMs Random? by sgk284 on Friday May 02, 2025 @04:52AM (#43867560)

The two mechanisms are a bit disjoint, so I don't think it's the right tool to do so. Though it could have been an interesting experiment.

[ Parent | on HN ]