Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by dragonwriter on Wednesday June 05, 2024 @12:10PM
(#40586709)
> I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain.
LLM-based systems with tool use (which this is an application of) often are, to an extent, the issue is tuning the (behind the scenes, system) prompting so that they use appropriate tools in every case where they should, and do so correctly. (There's also a cost factor involved since behind-the-scenes tool use means multiple LLM round trips to answer the question, so tuning the system to use tools more aggressively makes the system more expensive.)
LLM is the equivalent of recalling your times tables. Computer arithmetic is the equivalent of re-computing your times tables.