Some companies are releasing code that nobody on the owning team has ever read or reviewed, or has any inkling exists.
I'm not sure you've quite thought this through. "Holding it wrong" is very, very often the case, especially with technology.
The chatbots kept steering people toward uncreative ideas and overshadowing novel insights that might come from genuine domain expertise. AI generated meeting summaries became a force for miscommunication as they de-emphasized or even outright misrepresented what was really important about the conversation. And people became much worse at proving ideas out before making significant resource commitments thanks to effects that we now describe with terms like AI psychosis.
All AI is doing here is rapidly identifying the people who have Peter-principled themselves.
> It's a lot easier for a human to organically have good ideas than to refute LLM-generated ideas that are a dead end.
What works better is when you can use an LLM to obtain a negative opinion on your own ideas that you think are good. LLMs aren't great at original thinking, but they're pretty good at finding the flaws in poorly thought-through human ideas.
I've seen much time wasted on strange ideas originated by an LLM. It's a lot easier for a human to organically have good ideas than to refute LLM-generated ideas that are a dead end.