Re:I wrote a Goodreads scraper in Python
by kylebenzle on Monday December 21, 2020 @06:43PM
(#25501151)
Start with a list of books and this python (Selenium) scraper with get all the data GoodReads has including difficult to grab stuff like reviews and alternative prices.
[ Parent
| on HN ]
Re:I wrote a Goodreads scraper in Python
by dave_4_bagels on Monday December 21, 2020 @06:49PM
(#25501186)
I've been waiting to see how the scraping space moves forward in a post-selenium world. I cut my teeth at startups writing scrapers that walked private facebook groups. It's been curious to see a few interesting innovations that you can read publicly - like containerized "workers" and clever networking hacks to scale. This guy who wrote an only-fans scraper to judge the income disparity of OF creators was pretty interesting [0]