Re:Non-determinism in GPT-4 is caused by Sparse MoE
by thaw13579 on Saturday August 05, 2023 @03:36PM
(#37015584)
I think whether it’s a bug or not depends on the software requirements and expectations. If the code has some expected bounds on runtime, switching the GPU code to sequential processing (for the sake of exact reproducibility) would break that expectation and could be considered a bug as well. If we expect performant code and exact reproducibility, that just might not be possible…
[ Parent
| on HN ]
There are no comments on this comment yet.