I don‘t think it will play out like this. Companies currently build systems to make the data robust/structured, to enforce a business process etc. Since they do not believe in answers any individual would give out of the unstructured data, they would also not trust an AI, and rightfully so. ChatGPT is not trustworthy at all and there is currently no path to make it so.
I worked in ontologies, focusing on making rigorous schemas for better data quality and easier integration. Our lunch was eaten by schemaless databases and big data. We protested that they wouldn't like what happened years down the line, but it was cheaper to start.
I don't mean to shake my tiny fist or overgeneralize my experience. But I think if AI gives good enough answers enough of the time, with a tiny fraction of the effort, people might just adapt around that model. People would rather have good now than great later. Or even mediocre now.
Honestly it doesn't sound crazy to me.
Another big issue that gets overlooked is that a lot of the problems that programming is used to solve today will disappear and no longer be considered problems to begin with. A whole lot of data conversion is no longer necessary when you have an AI that can directly interface with the raw data and manipulate it in whatever format you like.
People today are thinking of ChatGPT as making it easier to build websites, software and such, but real the power of AI is that it makes all of that obsolete. Why bother browsing the Web when ChatGPT can just give you what you are looking for in whatever format you desire, without ever touching a website?
AI is not just going to write software, AI is going to be the only software you'll ever need. BingChat today is already Photoshop, Shell and Webbrowser all in one. Won't be long until it learns to do most of the rest as well.
The interesting question is: What will be left after all this? If we automate away all the boring parts, what are going to be the bits that provide value? How will the Website of the future look like when AI will be the only one reading them? What's the value of a classic book when AI can write new books in real time? Will anybody bother with video games when they have a Holodeck at home?