Re:LLMs Can't Do Probability
by nextaccountic on Wednesday May 01, 2024 @01:00PM
(#40226018)
> (ignoring for a second that some fairly common optimisations introduce data races in the GPU).
Okay so are any GPU compilers intentionally introducing data races in programs that previously exhibited no data races?
Not really compilers, but the underlying GPU libraries.
Here’s a good jumping off point: https://pytorch.org/docs/stable/generated/torch.use_determin...
On the other hand, does it really matter? With a slight tweak to the prompt, ChatGPT generates some serviceable code: