And whether you always have to check everything is a separate question from nondeterminism. You could have a deterministic heuristic that is often wrong in a domain where mistakes are fatal, or you could have a nondeterministic model that is almost always correct for a task where errors cost next to nothing.
https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
FYI, your source is medium-walled blog spam of https://152334h.github.io/blog/non-determinism-in-gpt-4/
As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level
They could sell you a version where you shove in a whole batch, pay $batch_size as much, and always get the same result for the same batch.
ChatGPT changes this seed under the hood with each request
https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
But LLMs are deterministic when all the parameters are the same between inferences
That's what renders it nearly useless for such tasks, because you always have to check everything.