News for hackers. Stuff that matters.
Re:How to scrape anything on the web and not get caught by tzahola on Sunday April 22, 2018 @05:12AM (#16895374)
Won’t work. Adversaries can taint your data by sending back fake results.
Re:How to scrape anything on the web and not get caught by amelius on Sunday April 22, 2018 @05:19AM (#16895391)
Could multiple downloads and a "consensus" algorithm solve this problem?
Re:How to scrape anything on the web and not get caught by tzahola on Sunday April 22, 2018 @06:27AM (#16895549)
Kinda, but it’s far from trivial as you would need some sort of tolerance when comparing sites with dynamic content.