Are we trying to produce adults who are able to think critically and creatively, and who reach their full intellectual potential, or are we trying to produce adults who can push a few buttons and blindly believe what the machine tells them?

If we end up producing adults who can't think critically or creatively, then we haven't succeeded in figuring out a way to teach kids assuming they will use AIs.

> In fact, [writing] will introduce forgetfulness into the soul of those who learn it: they will not practice using their memory because they will put their trust in writing, which is external and depends on signs that belong to others, instead of trying to remember from the inside, completely on their own.

- attributed to Socrates by Plato. c.399-347 BCE. “Phaedrus.”

Pretty sure there's a fallacy named after this whole "hey this is just exactly like before so we have nothing to be concerned about".

The point is that all technology is a tool. Whether it be writing, calculators, or various narrow AI software. We can either bemoan the loss of a now-less-useful skill (memorization, long division, longform writing), or learn how to use these tools to better achieve our goals.

Technologies develop for different purposes and have different effects. Modern digital technology has a very inhumane origin story, as noted in “New Dark Age” by James Bridle, and other works. https://jamesbridle.com/books/new-dark-age

While likely not how it would be work out in practice, you would hope that with better tools would also come higher standards. If you expect more complex, more thorough, and/or less error-prone output from students using AI then you don’t necessarily have to lower how much critical and creative insight they need to have. Like the difference in a test that does and doesn’t allow calculators, you always have to fit the assignments to the tools that are used for them.

Definitely the second one

The scene from the film Idiocracy where the main character is being triaged in a doctor's office comes to mind.

The short story MANNA about AI directed folks and the future that creates comes to mind:

https://marshallbrain.com/manna1

The average human hates changes of things they've grown used to.

People are very attached to school being just like it was when they went.

As long as it pushes the students into mental effort I have no problem with changes in education. The world changes, it’s normal to have changes. But there’s nothing wrong to compare against prior models, sometimes we revisit abandoned ideas, artworks, models etc

Isn't the problem that kids (like all of us) are lazy and would rather use tools than their brain, rather than people trying to keep school "just like it was"?

Learn your times tables and then learn to use a calculator.

If you don’t do it that way, you’ll always be fooled by whatever the screen tells you.

That's how we teach today, but that doesn't mean it's the only way. As a counter example, in chess, AI makes a great learning partner, and from beginners to world champions the level of proficiency has increased immensely in the last 30 years due to better chess engines.