News for hackers. Stuff that matters.

A comment on Google wants to make you feel like you're on a crowded train to up ad engagement. Parent comment

Re:Google wants to make you feel like you're on a crowded tr... by perl4ever on Friday August 16, 2019 @11:45PM (#20721869)
I was thinking about this. I'm lazy and not very talented, so is there any decent code existing and open sourced that could be adapted to spider only sites without advertising?
[ Parent | on HN ]
Re:Google wants to make you feel like you're on a crowded tr... by ErikAugust on Saturday August 17, 2019 @12:31AM (#20722061)
Just crawl, and then disregard sites that have certain scripts present.
[ Parent | on HN ]
Re:Google wants to make you feel like you're on a crowded tr... by anon1m0us on Saturday August 17, 2019 @03:41AM (#20722761)
Yeah, technically, it'd be very easy. I've written countless spiders, crawlers, etc.

Basically, only index items where webpage.indexOf('google') < 0

[ Parent | on HN ]