Re:Non-determinism in GPT-4 is caused by Sparse MoE
by zx14 on Saturday August 05, 2023 @03:49AM
(#37009929)
There isn't much of a culture around code quality in ML / AI / DS.
[ Parent
| on HN ]
Re:Non-determinism in GPT-4 is caused by Sparse MoE
by PeterisP on Saturday August 05, 2023 @04:20AM
(#37010076)
It's not a code quality issue, there are ways to ensure determinism (sometimes you just need to set a flag), however, they are intentionally explicitly not used in order to gain performance.