Re:Does the success of LLM support Wittgenstein's position t...
by idle_zealot on Friday August 02, 2024 @01:41PM
(#41140873)
Consider that what people often mean by "stop hallucinating" is more like "stop making errors that a human wouldn't." I don't think most people believe that a powerful enough LLM would be capable of 100% accuracy in all tasks.
For example: the premise that, with enough data and compute resources, LLMs will simply stop hallucinating. This implies there is some latent space of "Truth", essentially the empirical realization of Platonic idealism.
What's funny is that I've often seen people argue aggressively in favor that LLMs will stop hallucinating who I'm pretty sure would also strongly reject Platonic idealism, leading to a sort of implied contradiction in their reasoning.