Do you realise how difficult this actually is? Millions of people have zero self-discipline with their consumption of social media.
One strategy I can think of is to remove the incentive to offload to AI, which probably means reducing the reliance on tests for evaluation. However, this also assumes intrinsic motivation within the students, which is also far from a given! Who's going to be motivated to do things the "hard way" when they don't even like the topic? Yet our curriculum is full of compulsory topics.
Like I said, none of our current systems are structured for this, and we'll probably have to figure things out from the ground up.
So, I agree with you, but it's also already been true for decades now with other tools.
A spellchecker is purely mechanical, it just helps you spell your essay right. But it won't make your essay good, or help you write the right essay.
WolframAlpha usually got to the correct answer, but often used a non-human strategy for integration. Generally, the best way to do it was simpler than what WolframAlpha's "step-by-step" showed, which was rather "brute force" and inelegant.
So, again, I agree. But again, it's a matter of degree and encompassing more domains vs. a binary change.
As a kid, I remember my teachers not allowing us to use calculators and times table pencils exactly to make us go through the painful process of using our brain to get to know math.
Today I'm doing a Master's on AI and AI is a tool I use not only to summarize, but to validate my understading. I don't jump into a GPT session asking it to do the exercise for me or to explain something. I ask it to help me finding out my error after inumerous tries; to say the same thing me in another words because English isn't my first language and often I don't know the terminology that the Academia uses; to write an analogy (which often absurd ones pop up); to guide me where I'm missing something.
It's a freaking powerful learning tool if used properly.
The centuries of literature we have on this contrasts hands-on practice with theory: not actually doing the thing, but studying how other people do it, in order to gain knowledge that will be helpful when you get your hands into it.
This is different: this is like having a slave do it for you.
We know from history that the slave owners didn't know how to do the work. E.g. kings and feudal lords didn't know how to herd animals or raise grains, etc.
Pencil and paper exams, taken in person with all electronic devices prohibited.
Edited to add: I think this is worth trying, but not nearly sufficient. I would not be surprised if all we see is that grades plummet because until the pen-and-paper tests the students have just been winging it with AI.
https://www.ed.gov/about/homeroom-blog/addressing-grade-infl...
https://fordhaminstitute.org/national/commentary/grade-infla...
You can build muscles by digging a field by hand but most people commercially use tractors. And operating tractors is a skill but a different one.
I imagine it'll go like that with AI. People will use it and learn the skill of using AI.
I mean you can learn the skill the machine does if you want like learning to write machine code rather than using a compiler but there may be a limited number of people doing that.
For instance, what we're seeing with pure vibe-coding is that even the best models make small mistakes, usually in the architecture but often in even lower-level abstractions, that compound over time resulting in unmanageable complexity. Senior engineers are able to spot and fix these issues early based on intuition, but that intuition has come from a lot of hands-on experience.
Using AI for a given skill is becoming a separate skill in itself, for sure. But this still requires having an understanding of the original skill itself.
I think this requirement won't change until we have super-intelligence, where AI is consistently much better than humans, i.e. beyond AGI. Because even at human-level performance, the only human that can verify an expert's work is another expert.
Our only value in an LLM dominated world is the ability to handle the situations that the LLMs can't. Those who let their skills and critical thinking atrophy (or never built them in the first place), well, they're simply not going to make it. Shepherding LLMs is not a difficult skill to acquire and isn't going to be enough to let us maintain our value.
Have you met a farmer? Most farmers are strong as all hell.
One of the most impactful things in my career was watching Simple Made Easy by Rich Hickey
our industry is part engineering | part art (i.e having taste) - A.I doesn't have taste (hence why vibe coding) doesn't work - the art of engineering is reducing the amount of code you've to write
it's not about saying YES to every feature - but saying NO and shipping the most impactful feature in the smallest amount of time. sometimes it's about stepping back to relearn so you can do things the right way.
whereas AI is about producing the most amount of code possible - which is the very antithesis of Software Engineering
I would argue that it's _scaling_ software development?
Making it so that you can create bigger programs: that accomodate more contributors, more requirements, faster, with more features, while being more correct, etc, without everything collapsing into spaghetti and chaos?
Historically, keeping a close eye on lines of code spent helped a lot along most axes. Finding ways to keep "code spent" down will remain very valuable but I don't think it's the _only_ way to scale?
Along the way we've developed architecture conventions, useful interfaces, test practices, standards, protocols, plugins & extension points, package repositories, etc. There are also social technologies like mailing lists, SIGs, bdfls, modern project & product management, etc etc.
To the extent that simplicity is measurable (less LoC spent, less code coupling, less cyclomatic complexity) it seems like it can be addressed as an optimisation problem and automated.
In fact, this is nothing new, and even encoded as a requirement for many professions like lawyers and doctors: to maintain their licenses, they are required to take hours of "professional development" every year or so to keep their skills up-to-date.
This process is regularly gamed, of course, but I suspect with AI people won't have that luxury.
I suspect the progression will be "No AI until intuition (whatever that is for that skill)" -> "Gradual use of AI to understand where it falls short" -> "AI native expert".
How to actually implement this at scale is still TBD ;-) Ironically, AI will be invaluable for this e.g. as a hyper-personalized tutor but it will also present an irresistible temptation to offload the hands-on practice. We already have studies indicating the former is helpful but the latter stifles mastery. At this point I can only see self-discipline as a mechanism to willingly avoid AI.
Unfortunately, our testing-oriented education system only serves to incentivize over-reliance on AI (Goodhart's Law etc.) None of our current institutions and processes are suited for what is already happening and will only accelerate from here on. Things will need to change radically.
For this reason, I once predicted apprenticeships will be a thing again, and already there are signs with Microsoft's preceptorship proposal: https://dl.acm.org/doi/10.1145/3779312
This is highly encouraging because a tech giant is not only acknowledging the problem, but proposing a solution. Not a complete solution by far but at least a start.