Re:Sutskever: OpenAI board doing its mission to build AGI th...
by oivey on Saturday November 18, 2023 @01:37AM
(#38316210)
Right, so it isn’t intuitively a hard task. It’s hard in the framework of ChatGPT’s design. That design is majorly powerful, but isn’t a great one for this basic task.
Re:Sutskever: OpenAI board doing its mission to build AGI th...
by arthurcolle on Wednesday November 22, 2023 @11:56PM
(#38389455)
with a tool, an LLM agent can easily perform this task. If it evaluates its performance against a bunch of different tools and then learns, this is learnable. just not with pure LLM approach
So to reverse the string, it can't just learn a kind of generic string reversal algorithm that goes character-by-character and outputs a result character-by-character. If it learned to output the tokens in reverse order, it would give a wrong answer (something like '926373...936473'.) Instead it has to learn something more complicated, like how each token is related to some other token that is its reverse, or how to identify it as a computational task and run some Python.