Re:ChatGPT in Academic Writing
by clbrmbr on Sunday March 05, 2023 @07:18PM
(#35035836)
That’s because it’s configured to with non-zero temperature. I’d you use the underlying model API, or the playground, you can get repeatable results when temperature is zero.
[ Parent
| on HN ]
You can also generally set an RNG seed to get reproducible results.
Mostly, yes, but there have been reported cases where even with zero temperature, you get nondeterminism, probably due to accumulation of errors due to different operation order on floating points.