>It also has trouble counting letters and words, though that’s largely due to its autoregressive nature.
It sees tokens not words or letters and there aren't many instances of counting occurring in text so it doesn't get learnt.
>and I really think it’s emergent, but at its core it doesn’t seem very “intelligent”
and we're back to the trust me bro argument. It's not intelligent because you say it isn't not because it doesn't perform a great many tasks intelligently. if you say so
That's the minimum. It's far above average for most things.
>Maybe, because quite a lot of people aren’t very smart.
Lol okay..and ?
>But even GPT4 struggles with complex logic problems
So does everyone else
>and when it makes logic errors it makes ones a human would spot
people spot mistakes they're capable of making all the time
and so can GPT-4 - https://arxiv.org/abs/2303.11366 https://twitter.com/johnjnay/status/1639362071807549446
>It also has trouble counting letters and words, though that’s largely due to its autoregressive nature.
It sees tokens not words or letters and there aren't many instances of counting occurring in text so it doesn't get learnt.
>and I really think it’s emergent, but at its core it doesn’t seem very “intelligent”
and we're back to the trust me bro argument. It's not intelligent because you say it isn't not because it doesn't perform a great many tasks intelligently. if you say so