Re:I Don’t Need No Stinking API: Web Scraping For Fun and Pr...
by RaSoJo on Sunday December 09, 2012 @02:52AM
(#4894189)
Yippie...that worked. Thanks a ton for sharing that code snippet.
Am unfortunately more of an analyst. Have only just started picking up coding for data analysis. JS scraping was one area that I always had difficulty with.
Not anymore :D
first install Xvfb and pyvirtualdisplay then try this snippet https://gist.github.com/4243582
selenium is great, it can even wait for ajax requests to finish (see WebDriverWait) ..