Re:Advanced NLP with SpaCy
by squeaky-clean on Sunday September 10, 2023 @04:18AM
(#37453894)
Even if you keep the same seed, it is non-deterministic.
https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
That link is dead.
Either way, you can’t interact with gpt4 without openai’s api, so you don’t know what they’re doing in between your request and inference.
But LLMs are deterministic when all the parameters are the same between inferences
ChatGPT changes this seed under the hood with each request