Re:ask HN: How does an LLM like GPT3 perform addition/division?
by childintime on Thursday March 16, 2023 @04:20AM
(#35179483)
I thought it apt to describe GPT3 as an alpha, because it did very well on language tasks and not so much on typical beta stuff, like math. Once it acquires well integrated hardcore logical solving abilities, then it'll not only be alpha or beta, but looking for ways to control its superhuman powers. Otherwise it'll go of on a tangent and kill itself in an infinite loop or put humanity in one.
On your question: how do we do it? We also have memorized the basics and apply a heuristic to do something more complicated, if necessary by analogy. Which is what GPT seems to be good at.
On your question: how do we do it? We also have memorized the basics and apply a heuristic to do something more complicated, if necessary by analogy. Which is what GPT seems to be good at.