Re:Have we stopped to think about what LLMs model?
by slowmovintarget on Sunday September 08, 2024 @02:36PM
(#41482163)
Just because the idea was expressed in science fiction, doesn't mean it's useful in the real world.
Solving a non-trivial problem that hasn't been solved before is not something random walks on text token probabilities will get you. Text production algorithms have the problem of being unable to detect whether the text produced is internally consistent, let alone true in the logical sense. These two qualities are required for creating net new solutions to unsolved next-level problems.
Solving a non-trivial problem that hasn't been solved before is not something random walks on text token probabilities will get you. Text production algorithms have the problem of being unable to detect whether the text produced is internally consistent, let alone true in the logical sense. These two qualities are required for creating net new solutions to unsolved next-level problems.