Re:Artificial Intelligence Is Stupid and Causal Reasoning Wi...
by Jensson on Tuesday December 27, 2022 @02:36PM
(#34152756)
It probably had problems with this part "two one dollar bills". A lot of text that contains "two" and "one" results in a "three", but also many texts with "two" and "one" results in "two", and then the model randomly chooses between those two interpretations. The worst part is that it doesn't even do it consistently for the same piece of text, creating that nonsense.
https://i.imgur.com/im9EquK.png
Perhaps it's magic trick that a language model can do math, but it's quite impressive that it gets very close to the desired answer.