"what a human brain does to generate the next word" != "how a human brain works"

> Consider the very common case of tiny humans that are clearly intelligent but lack the facilities of language.

Sign language can be taught to children at a very early age. It takes time for the body to learn how to control the complex set of apparatuses needed for speech, but the language part of the brain is hooked up pretty early on.

Small human brains just don't have their fine tuning yet.

But from all the studies we have, brains are just highly connected neural networks which is what the transformers try to replicate. The more interesting part is how they can operate so quickly when the signals move so slowly compared to computers.

The story that sticks with me is the lady who had some surgery done. After she woke up was unconvinced anything had happened told a joke and then passed out. Only to wake up a few mins later and repeat that cycle a few times because the drug was messing with her short term memory. It really bends your brain do we have free will or not.