Of course this would possibly exclude using SaaS-based LLMs like ChatGPT in places like schools, and as such it might make sense to require students to utilize open ones. Or maybe, if OpenAI provided a verification service whereby a prompt could be checked against the output it supposedly produced in the past at some point (even if the behavior of the chatbot had since changed).
I mostly disagree (and I used WolframAlpha thoroughly during my engineering education). Wolfram can solve well encapsulated tasks (solve for X, find the integral, etc). Even then often it gives you a huge expression, whereas doing it by hand you can achieve a much simpler expression.
It doesn't really handle complex problems, at least like the ones you'd find in a college level math or physics course. It can be a tool for solving certain steps within those problems (like a calculator), but you can't plug the whole thing into Wolfram and get an answer.
GPT4 is kinda OK at this, like 50%+ success rate probably, highly dependent on how common the problem is.
Those complex problems are taught and asked in college level classes because of Wolfram Alpha. Like the parent commenter mentioned, classes had to adapt to new technology and since Wolfram Alpha could solve the straightforward questions, college classes started asking more complex ones with multiple steps and where the problem needs to be reframed in order to actually solve it.
I don't like this. It seems to me that this would lead to teachers forcing formulaic approaches to writing on children (even more than they already do). No uniform process is going to work on everyone and having students write using a process like that produces bland, uninspired and unmotivated essays.
Furthermore, outlines and revision histories also seem easy enough to fake with a GPT-like AI: you can just ask the AI to write an outline and then have it iterate on that.
- Make kids show their work (outlines, revision histories)
- Retool to focus on the things where the tools can't do all the work (proofs, diagrams, word problems for math; research, note gathering, synthesizing for writing)
- After kids learn the basics, incorporate the tools into the class in a semi-realistic way (using a TI-whatever in the last years of high school math education)