Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by marzell on Wednesday June 05, 2024 @02:24PM
(#40588476)
I believe the "thinking out loud" is fundamentally part of the process of "text completion" which is what it is doing. Certainly we can (and do) break things apart and add layers that could be used to effectively do this by adding more steps and processing time. But ultimately in a single turn, the entire conversation up to that point (including instructions you may have added telling it to not think out loud) is the input, and the output will reflect that.
If it really needs to do this 'thinking out loud', could it do that under the hood and not in the final output on my screen? Its first pass could use as many words as it wants to compute the answer, but once the answer is computed please go back and make it short.
Not to take away from your point that maybe the prompt is the problem in these reasoning questions.