News for hackers. Stuff that matters.
Re:Ask HN: Building a side project that makes money. Where t... by bbayer on Thursday April 06, 2017 @02:26AM (#14048384)
Thanks for the reply. Did you face any issues during crawling process like access restrictions. If you share your practice I will be appreciated.
Re:Ask HN: Building a side project that makes money. Where t... by humanbot on Thursday April 06, 2017 @03:28AM (#14048628)
My crawler is modified from https://github.com/KopLyf/GPlayCrawler. Crawled 100k+ apps without any access issue.
Re:Ask HN: Building a side project that makes money. Where t... by nurettin on Friday April 07, 2017 @02:03PM (#14062042)
I just tested this with `apt install python-scrapy python-pymongo && scrapy crawl google`. It seems to download one by one.

Edit: Interesting, it also downloads comments in my locale. Google play seems to be responding according to my IP information.