“Predicting the next token” is a bad argument, as it completely ignores all the emergent properties of transformer models. It’s like saying that discreet electrical impulses from sodium/ potassium transporters is the beginning and end of what neuroscience describes.