Why are LLMs general learners?

Re:Why are LLMs general learners? by BobbyJo on Monday June 12, 2023 @10:44PM (#36304491)

I do think that LLMs have emergent properties that do some interesting things, however I would like to point out simple next token prediction would work on your example quite well.

<numbers>0 + 1 -> <numbers>1

Even simple attention mechanisms would handle that quite well with enough examples of <numbers>

[ Parent | on HN ]

Re:Why are LLMs general learners? by doctor_eval on Monday June 12, 2023 @11:48PM (#36304977)

I agree with you, but it also works for

    4320598340958340958340953095809348509348503480958340958304985038530999999 + 1 ?

    The sum of 4320598340958340958340953095809348509348503480958340958304985038530999999 and 1 is 4320598340958340958340953095809348509348503480958340958304985038531000000.

which is more complex.

I'm too lazy to get it to add two large numbers together.

Also, I've never been convinced that "ability to do arithmetic" has any relationship to intelligence. We don't expect regular humans to be able to add two large numbers together reliably, either.

[ Parent | on HN ]