News for hackers. Stuff that matters.
Re:Introduction to web scraping with Python by wootie512 on Tuesday October 24, 2017 @08:50AM (#15541149)
I am just getting into web scraping and have also been using Selenium with either Firefox or PhantomJS. Is there a better way to handle the javascript heavy sites? I found one library called dryscraping but haven't had the time to look too deep into it.
Re:Introduction to web scraping with Python by RhodesianHunter on Tuesday October 24, 2017 @09:02AM (#15541200)
Take a look at the Google team's Puppeteer

https://github.com/GoogleChrome/puppeteer

Re:Introduction to web scraping with Python by brianwawok on Tuesday October 24, 2017 @09:30AM (#15541356)
Splash runs in docker and does a decent job. From the scrapinghub team.