Obviously I haven't read this whole thing during my lunch break but if what you say is true then it explains a lot about why search quality has suffered the last ten years.

Forums, personal blogs and niche websites are often exactly what I want.