News for hackers. Stuff that matters.

A comment on Ferret – Declarative web scraping. Parent comment

Re:Ferret – Declarative web scraping by sephware on Tuesday October 02, 2018 @05:09PM (#18125722)
"Much more effort"? Right now it implements a library and a language on top of that. Making it just be a library would cut the work in half.
[ Parent | on HN ]
Re:Ferret – Declarative web scraping by ziflex on Tuesday October 02, 2018 @05:30PM (#18125877)
The idea is to create a high level abstraction that represents your web scraping logic. The project is still WIP. I will create a web server which will help you to store your queries, schedule them and set up output stream to other systems like Spark and Flink.
[ Parent | on HN ]