forgetting to carry a 1 makes a lot of sense knowing GPT-3 is just a giant predict before-after model. Seeing 2000 problems it probably gets a good sense of how numbers add/subtract together, but there's not enough specificity to work out the specific carrying rule.