News for hackers. Stuff that matters.
Re:Show HN: A Python Spider System with Web UI by pknerd on Monday November 17, 2014 @12:24PM (#8619213)
But will it not be slow? Assuming downloading css/images etc?
Re:Show HN: A Python Spider System with Web UI by binux on Monday November 17, 2014 @12:47PM (#8619339)
Images not downloaded default. Both the fetcher and the phantomjs proxy is totally async.