Re:Introduction to web scraping with Python
by wootie512 on Tuesday October 24, 2017 @08:50AM
(#15541149)
I am just getting into web scraping and have also been using Selenium with either Firefox or PhantomJS. Is there a better way to handle the javascript heavy sites? I found one library called dryscraping but haven't had the time to look too deep into it.
[ Parent
| on HN ]
Re:Introduction to web scraping with Python
by RhodesianHunter on Tuesday October 24, 2017 @09:02AM
(#15541200)
Take a look at the Google team's Puppeteer
Re:Introduction to web scraping with Python
by brianwawok on Tuesday October 24, 2017 @09:30AM
(#15541356)
Splash runs in docker and does a decent job. From the scrapinghub team.