News for hackers. Stuff that matters.

A comment on Build a crawler to crawl million pages with only one machine in just 2 hours. Parent comment

Re:Build a crawler to crawl million pages with only one mach... by foobiekr on Tuesday February 28, 2017 @04:49PM (#13758339)
No one else has mentioned it, but evaluating javascript on random webpages is something that one would need to be deeply careful about.
[ Parent | on HN ]
Re:Build a crawler to crawl million pages with only one mach... by drwl on Wednesday March 01, 2017 @11:06AM (#13764805)
Care to elaborate?
[ Parent | on HN ]