Portia, an open-source visual web scraper

Re:Portia, an open-source visual web scraper by egb on Tuesday April 01, 2014 @12:52PM (#7509693)

Answering my own question:

CasperJS is an open source navigation scripting & testing utility written in Javascript for the PhantomJS WebKit headless browser and SlimerJS (Gecko). It eases the process of defining a full navigation scenario and provides useful high-level functions, methods & syntactic sugar for doing common tasks such as:

    defining & ordering browsing navigation steps
    filling & submitting forms
    clicking & following links
    capturing screenshots of a page (or part of it)
    testing remote DOM
    logging events
    downloading resources, including binary ones
    writing functional test suites, saving results as JUnit XML
    scraping Web contents

[ Parent | on HN ]

Re:Portia, an open-source visual web scraper by mopoke on Wednesday April 02, 2014 @04:42AM (#7514282)

I wrote a blog post on my experiences using CasperJS to parse a single page site which used angular. http://www.andykelk.net/tech/web-scraping-with-casperjs

[ Parent | on HN ]