I really don't know what a good customer-centric endgame looks like. Maybe a self hosted AI assistant that knows what I need, coupled with a micropayment infrastructure to apportion funds based on where I visit? No idea.
Several reasons:
1. You often can't judge the value of the information before purchase.
2. The downside of having to decide whether or not to purchase is often larger than the value of the information.
3. Microtransaction costs (time and otherwise) are higher than the value of the information.
4. That information is often available for free somewhere else (sometimes people just want attention or to inform others rather than money). The top results are just the ones that spent the most money on SEO (and hence have the most intrusive ads).
Do companies exist to make things that are valuable for users, or do users exist to make money for companies?