News for hackers. Stuff that matters.
Re:Non-determinism in GPT-4 is caused by Sparse MoE by phillipcarter on Friday August 04, 2023 @07:40PM (#37007292)
Yeah, it's one of the first things you notice when trying to do some kind of "feed GPT some data and get it to produce a novel answer to a question" task with the API.
Re:Non-determinism in GPT-4 is caused by Sparse MoE by refulgentis on Friday August 04, 2023 @09:48PM (#37008165)
No, because if you wanted a novel answer, why would you set 0 temperature? ;)