> And they don't have a choice about this; they must predict the next word, even if it means that they have to make something up.

No, they could easily generate the end-of-sequence symbol, or the words “I don’t know.”