It's not usually that you ask them a question they can't answer, and they just confidently make up something entirely wrong, and possibly also an incorrect explanation that few or no other people have seen.
It's a different kind of wrong. One can write a book addressing common misconceptions picked up in school, from human teachers, and cover much of it. Does that work for lies AIs tell? They could be about almost anything, they could be broadly wrong, they could be subtly wrong, et c. "Show me some things my teachers may have been wrong about" seems to me an easier request to adequately address than "show me some things my AI tutors lied about", because the former tend to cluster around a kind of common space and form an experience with a great deal of overlap between students, while I'm not sure the latter do.
What's the analog of that with human teachers, and how long would it take to implement a solution there? Even if you had all the budget in the world, how would you go about making all teachers stop misleading students about how airplane lift works?
Most humans have the decency to not do the latter while AI (at the moment) freely makes up complete lies when it doesn't have the answer instead of just admitting it doesn't know.