News for hackers. Stuff that matters.

A comment on Web Scraping: Bypassing “403 Forbidden,” captchas, and more. Parent comment

Re:Web Scraping: Bypassing “403 Forbidden,” captchas, and more by ben_jones on Thursday March 16, 2017 @10:31AM (#13885281)
Well the problem is when someone scrapes ALL the good listings then pre-purchases them for resale at double the cost.
[ Parent | on HN ]
Re:Web Scraping: Bypassing “403 Forbidden,” captchas, and more by Raphmedia on Thursday March 16, 2017 @11:44AM (#13885955)
How is it different than paying 50+ low-wage remote workers to "scrape" the phonebook for you and then using the information acquired for profit?
[ Parent | on HN ]
Re:Web Scraping: Bypassing “403 Forbidden,” captchas, and more by greglindahl on Thursday March 16, 2017 @12:55PM (#13886593)
One difference is that Feist v. Rural Telephone says that the data in a phonebook can't be copyrighted.

https://en.wikipedia.org/wiki/Feist_Publications,_Inc.,_v._R....

[ Parent | on HN ]
Re:Web Scraping: Bypassing “403 Forbidden,” captchas, and more by Raphmedia on Thursday March 16, 2017 @01:00PM (#13886647)
What about using those employees to "crawl" the web for you then?
[ Parent | on HN ]
Re:Web Scraping: Bypassing “403 Forbidden,” captchas, and more by greglindahl on Thursday March 16, 2017 @03:23PM (#13888241)
I suspect it's roughly the same as a crawer -- same issues of fair use, TOS/CFAA, etc -- but likely there's no expectation that humans will read and follow robots.txt.
[ Parent | on HN ]