Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by voxic11 on Thursday June 06, 2024 @02:57AM
(#40594361)
For me it did in fact follow the instruction and found the right answer. I have found this strategy of asking the LLM to analyze why its answer might be wrong results in better final answers. I think this allows the LLM to "use tokens to think" which allows the attention layers to gather the right cognitive resources to answer more subtitle questions effectively.
[ Parent
| on HN ]
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by daveguy on Thursday June 06, 2024 @08:45AM
(#40596734)
You are confusing "providing the right answer" with "following the instruction". Cause vs correlation. From an algorithmic perspective it is literally doing the exact same thing regardless of prompt.