News for hackers. Stuff that matters.
Re:Non-determinism in GPT-4 is caused by Sparse MoE by zx14 on Saturday August 05, 2023 @03:49AM (#37009929)
There isn't much of a culture around code quality in ML / AI / DS.
Re:Non-determinism in GPT-4 is caused by Sparse MoE by PeterisP on Saturday August 05, 2023 @04:20AM (#37010076)
It's not a code quality issue, there are ways to ensure determinism (sometimes you just need to set a flag), however, they are intentionally explicitly not used in order to gain performance.