Re:Congrats! Web scraping is legal! (US precedent)
by briandear on Wednesday January 29, 2020 @12:04PM
(#22182883)
Who pays for that API and the bandwidth? What’s in it for the data provider? On LinkedIn, viewing the data now shows ads or at least prompts the viewer to join the network. With scrapping and free API access, how exactly does LinkedIn benefit for their work of hosting the data?
[ Parent
| on HN ]
Re:Congrats! Web scraping is legal! (US precedent)
by 0x445442 on Wednesday January 29, 2020 @12:17PM
(#22183071)
My guess is hiQ (and others) would happily pay for an API over the data they're scraping right now.
Re:Congrats! Web scraping is legal! (US precedent)
by gregmac on Wednesday January 29, 2020 @12:38PM
(#22183374)
Unless the costs exceed their current operational costs. Don't forget the time spent redeveloping on the new API, which includes validating everything is there, testing and cleaning up and removing the old (working) code.
Re:Congrats! Web scraping is legal! (US precedent)
by munificent on Wednesday January 29, 2020 @12:41PM
(#22183418)
Why buy the cow when you get the milk for free?
Re:Congrats! Web scraping is legal! (US precedent)
by munk-a on Wednesday January 29, 2020 @01:09PM
(#22183815)
This isn't a great analogy here - getting the data delivered via API is simply more useful than having to re-assemble that data out of fragments parsed off of different web calls.
Could I suggest:
"Why buy the cheese when you get the milk for free?"
Re:Congrats! Web scraping is legal! (US precedent)
by coryfklein on Wednesday January 29, 2020 @03:26PM
(#22185417)
Look, if you build a product that relies on providing free information to the public, then you don't get to select a segment of that public and charge them for it. You can't hang a billboard on a highway, but then get upset when some people look at it the wrong way.
Now, if you want to have a walled garden and charge for entry to some and let others in free then that is fine.