News for hackers. Stuff that matters.

A comment on List of apps people pay for but have low rating. Parent comment

Re:List of apps people pay for but have low rating by Scoundreller on Saturday May 01, 2021 @01:54PM (#27008296)
Dunno about Atlassian and Shopify, but I can’t imagine Google launching a case against someone for scraping them.

I guess robots.txt is all that really matters.

Here’s Play Store’s: https://play.google.com/robots.txt

[ Parent | on HN ]
Re:List of apps people pay for but have low rating by akudha on Saturday May 01, 2021 @02:00PM (#27008350)
This data is quite valuable and services like this aren't competing with these app stores. If anything, they are probably inviting more competition to the app stores resulting in better apps.

There is no reason for these companies to go after some small guy scraping the app store data. But who knows - Craigslist went after one man shops. These companies might too.

[ Parent | on HN ]
Re:List of apps people pay for but have low rating by minnehaha on Saturday May 01, 2021 @01:59PM (#27008345)
agreed, provided the crawler complies with robots.txt
[ Parent | on HN ]