Oh, I agree. Optimistically, the existence of LLMs will be a forcing function for education to focus on what actually matters. (IMO, this is the ability to critically assess and generate arguments, something GPT isn't particularly good at (yet)).

But your example is actually rather striking. In most highschool and college classes for algebra and calculus, we're asking students to solve/prove problems that computers have been easily able to solve/prove, and have been for decades.

But the educational consensus is that being able to do algebra or differentiate/integrate by hand is valuable (up to a certain complexity.) Which is why calculators are not allowed (at certain levels) and why "show your work" is an important part of grading at every level.

Perhaps this whole discussion is a nothingburger once we figure out what the language arts equivalent to "show your work" is for text generation.