News for hackers. Stuff that matters.

A comment on Non-determinism in GPT-4 is caused by Sparse MoE. Parent comment

Re:Non-determinism in GPT-4 is caused by Sparse MoE by toxik on Saturday August 05, 2023 @02:53AM (#37009635)
Minor nit but commutative is the wrong term. Floats always obey a+b == b+a, but not associativity: (a+b)+c != a+(b+c).
[ Parent | on HN ]
Re:Non-determinism in GPT-4 is caused by Sparse MoE by KolenCh on Saturday August 05, 2023 @04:54PM (#37016207)
Right!
[ Parent | on HN ]