Re:Why are LLMs general learners?
by SkyPuncher on Tuesday June 13, 2023 @12:05AM
(#36305131)
I suspect most people on this forum can do arithmetic for any "reasonable" size number. It might take weeks to complete, but most people on this forum can calculate large numbers by hand.
[ Parent
| on HN ]
If its going to take weeks, most people will get it wrong. That's a lot of calculations to never get wrong and never misinterpret some prior note you left
Post moving. "Reasonable" is just an arbitrary line. Especially since most if not all would make some mistake somewhere along the line.
You can greatly increase GPT's arithmetic capabilities tackling it like a problem to solve "on paper" in context. And this was done on 3.5 not 4. https://arxiv.org/abs/2211.09066