News for hackers. Stuff that matters.
Re:AI Isn't Magic, It's Maths by perching_aix on Saturday June 14, 2025 @10:29AM (#44276657)
Small update: now that I brought it up, I figured I should just test it. And indeed, as long as the seed is pinned, the replies are bit-for-bit identical run to run (note that the conversation context was cleared before each attempt, of course).

So even setting the temp to 0 is not actually needed. This is handy in case somebody makes the claim that the randomness (nonzero temp parameter) makes a model perform better.

The devil really is in the "insignificant for humans but significant for the model" details, basically. Not in the computational determinism.

Re:AI Isn't Magic, It's Maths by xigoi on Saturday June 14, 2025 @11:39AM (#44277026)
A random number generator also gives deterministic results when you fix the seed. Does that make it not a random number generator?
Re:AI Isn't Magic, It's Maths by perching_aix on Saturday June 14, 2025 @11:56AM (#44277129)
Yes, it does. They're called pseudo-random number generators (PRNGs) in literature for that very reason.