A ten year old can transcribe arbitrarily complicated speech in their native tongue but could have difficulty summarizing it or generating it. There are more tasks to unlock with larger and larger language models, but the language model for figuring out the most likely utterance given the audio doesn't have to be nearly so big, just like a reasonable language model for summarizing can be much smaller than one for dialogue.