News for hackers. Stuff that matters.
Re:Advanced NLP with SpaCy by squeaky-clean on Sunday September 10, 2023 @04:18AM (#37453894)
Even if you keep the same seed, it is non-deterministic.

https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...

Re:Advanced NLP with SpaCy by dartos on Tuesday September 12, 2023 @07:36PM (#37490159)
That link is dead. Either way, you can’t interact with gpt4 without openai’s api, so you don’t know what they’re doing in between your request and inference.

But LLMs are deterministic when all the parameters are the same between inferences