organizationally, google is a hot mess that can't even figure out how to launch a product
Maybe, but for Google LLMs wouldn’t be a product, they’d be an algorithm behind the universal query box and conversational assistants, which are established products. Adding additional backing algorithms and changing output UI to prioritize their output isn’t something Google has a problem with, even if it arguably does with new product launches.
The traditional search-box-and-list-of-URLs at least provides attribution, which can be of huge value in some search scenarios.
If I have a health-related query, I want to see the links from research papers from legitimate institutions, or trusted authorities like the NHS. A human-language answer doesn't necessarily say "based on the groundbreaking research of wificausesherpes.com" at the end.
Any sort of comparison and recommendation searches are similarly iffy. That's why there are a trillion "best 8k webcam under $30 December 2022" affiliate-link-farm sites, but The Wirecutter and Consumer Reports still have some minor level of clout.
Google also has at least two generative models of their own that they, like OpenAI is criticised for, don't publish "just in case"; one for duplicating voices, and the LaMDA chatbot that got in the news before ChatGPT.
People will get tired of ads, but I bet someone will use a text agent to rewrite stories and scripts so heroic characters always enjoy the great taste of $beverage while saving the day, the lead romantic opportunity is $consumer_gender_preference and likes wearing $fashion_brand.