News for hackers. Stuff that matters.
Re:Ask HN: Does anyone have experience scraping dynamic cont... by bartonfink on Friday August 17, 2012 @06:24PM (#4399120)
You MAY be able to do this with Selenium, although I've never used Selenium to scrape streaming requests. It's going to depend quite a bit on how the page is structured.

I have used Selenium to scrape dynamic content before by waiting for new DOM elements to be populated by AJAX, so I know this sort of thing is possible in a way you couldn't do with wget.

There are no comments on this comment yet.