Re:RoboBrowser: Your friendly neighborhood web scraper
by brynedwards on Thursday May 12, 2016 @04:42AM
(#11682146)
I recently wrote a browser-driven scraper using Nightmare[1], which uses Electron under the hood. Another option for those who prefer python is dryscrape[2], although I haven't tried it.
[1] https://github.com/segmentio/nightmare
[2] http://dryscrape.readthedocs.io/en/latest/