Re:Transformers struggle with generalizing tasks beyond pre-...
by spywaregorilla on Tuesday November 07, 2023 @08:00PM
(#38185398)
Highly unlikely to work in the near future. LLMs are bad state machines.
But even if it did, you are basically describing programming in a contrived language, not the llm learning to do math. You can explicitly teach a model to follow an algorithm. But that's not the same as the algorithm being "learned" during training and "invoked" when asked what's 2 + 2?
But even if it did, you are basically describing programming in a contrived language, not the llm learning to do math. You can explicitly teach a model to follow an algorithm. But that's not the same as the algorithm being "learned" during training and "invoked" when asked what's 2 + 2?