Re:The Tragedy of Google Search
by TheHappyOddish on Sunday September 24, 2023 @05:46PM
(#37637500)
Good question. I've been using Kagi a long time but have never tried this feature. I just tried, and it does bypass the paywall. No idea which sites that works on, but I'd imagine it correlates with ons archive.is can bypass - I assume crawlers are just allowed to read the whole thing.
When I was using Bing AI or Google Bard to summarize an article, they often refuse to do so because of paywall or some other reasons.