Re:Understanding Reasoning LLMs
by Terr_ on Friday February 07, 2025 @02:45AM
(#42970415)
I think that would be a fundamental mismatch. LLMs are statistical and lossy and messy, which is what (paradoxically) permits them to get surprisingly-decent results out of messy problems that draw upon an enormous number and variety of messy examples.
But for a rigorously structured language with formal fixed meaning... Now the the LLM has no advantage anymore, only serious drawbacks and limitations. Save yourself millions of dollars and just write a normal parser, expression evaluator, SAT solver, etc.
You'll get answers faster, using fewer resources, with fewer fundamentally unfixable bugs, and it will actually be able to do math.
But for a rigorously structured language with formal fixed meaning... Now the the LLM has no advantage anymore, only serious drawbacks and limitations. Save yourself millions of dollars and just write a normal parser, expression evaluator, SAT solver, etc.
You'll get answers faster, using fewer resources, with fewer fundamentally unfixable bugs, and it will actually be able to do math.