Re:Transformers struggle with generalizing tasks beyond pre-...
by GaggiX on Tuesday November 07, 2023 @12:10PM
(#38179538)
If you give them a calculator they will be much better.
A better answer: every time the model needs to predict the digit of a sum the model needs to solve the entire addition to know the carries, a bigger sum requires a bigger model to solve them.
A better answer: every time the model needs to predict the digit of a sum the model needs to solve the entire addition to know the carries, a bigger sum requires a bigger model to solve them.