> I'm learning an admittedly fairly obscure african language, but one with tens of millions of speakers worldwide. LLM can produce intelligible but grammatically-incorrect and unidiomatic output.
This isn't a problem with the technology; it's easy to observe that it doesn't happen with better-known languages. Your problem is that you don't have a model for your target language.
> Is this better or worse than not helping at all? I'd argue worse.
My first instincts go that way too. But note that language classes consider it desirable for the students to try to speak with each other in the target language. (And not just where they can be supervised - the more they do it, in any context, the better.)
If the only input you ever get has the grammar incorrect, your grammar will also be incorrect. But you can handle a lot of your input being incorrect without major problems.
technically, you're correct. But I don't expect to see much given how resources for ai licenses are calculated.
It isn't clear if LLMs are good. The formal studies cannot possibly be done so don't bother looking. (a few early studies might be done, but not enough to draw conclusions). And of course LLMs may well change in the future so even if you have a conclusion it may not apply to what we see next year.
> They seem perfectly competent at communicating in whatever language you want
These two sentences contradict; that's the only thing you want for language learning.
> but for example, explaining grammatical concepts of one language in another language they have been surprisingly incompetent at in my experience
Doesn't matter.