News for hackers. Stuff that matters.

A comment on Show HN: Web Scraping Language (WSL).

Re:Show HN: Web Scraping Language (WSL) by Fudgel on Tuesday April 30, 2019 @01:33AM (#19785393)
What does it use to scrape? Is it just an xml/html parser, or does it run a headless browser?
[ Parent | on HN ]
Re:Show HN: Web Scraping Language (WSL) by scrape_it on Tuesday April 30, 2019 @01:59PM (#19790319)
It uses a sort of a DSL that I came up with, and removes a lot of boilerplate.

Headless yes.

You write WSL (Web Scraping Language) to scrape 2 pages of HN:

    GOTO news.ycombinator.com | EXTRACT {.morelink, 2} {news: .storylink}
(you may certainly remove that ' , 2 ' business based on the moral system you subscribe to)
[ Parent | on HN ]