News for hackers. Stuff that matters.

A comment on Ask HN: How can I filter out paywalls from my internet?. Parent comment

Re:Ask HN: How can I filter out paywalls from my internet? by thfuran on Sunday March 06, 2022 @11:25PM (#30584213)
Because their crawlers get special treatment and don't see the pay wall so they can index the pages and they don't care to double check because they are getting your ad money anyways.
[ Parent | on HN ]

There are no comments on this comment yet.