News for hackers. Stuff that matters.

A comment on Portia, an open-source visual web scraper. Parent comment

Re:Portia, an open-source visual web scraper by jdavis703 on Tuesday April 01, 2014 @02:42PM (#7510669)
These single page sites do have a public, albeit, undocumented API. If you analyze the network requests via the dev tools in your browser you'll have an XML/JSON data source that is probably structured better than the markup.
[ Parent | on HN ]
Re:Portia, an open-source visual web scraper by agumonkey on Tuesday April 01, 2014 @02:54PM (#7510772)
Of course, I should have thought about it that way.
[ Parent | on HN ]