People keep underestimating what next-token prediction can do, but they’re not wrong that it’s how LLM’s work.

It’s actually a good question: what will next-token prediction be able to do on new datasets? The error is thinking you can answer it, even in broad terms.