A random number generator also gives deterministic results when you fix the seed. Does that make it not a random number generator?
Re:AI Isn't Magic, It's Maths
by perching_aix on Saturday June 14, 2025 @11:56AM
(#44277129)
Yes, it does. They're called pseudo-random number generators (PRNGs) in literature for that very reason.
So even setting the temp to 0 is not actually needed. This is handy in case somebody makes the claim that the randomness (nonzero temp parameter) makes a model perform better.
The devil really is in the "insignificant for humans but significant for the model" details, basically. Not in the computational determinism.