And I won't know which ones are the wrong ones, so I may as well trust it 0% of the time.
Most people I know use AI Overview now as their primary way of doing any sort of research or question-answering... and I urge them: If getting an LLM take is suitable for your purpose, at least ask free-tier ChatGPT, which is at least an order of magnitude less likely to vomit up false or confused information. Also, asking actual Gemini is another sane option that is far superior to AI Overview.
Most people are not asking google to build them a train signaling system but to look up some question on Wikipedia for which the answer does not matter that much
Think of the incentives and the path of absolute least resistance/thinking/energy use and you will arrive at the product people want.
Does truth matter in the post-truth world where disclaiming truthful news about you is as easy as calling it fake?