News for hackers. Stuff that matters.

spoondocz

Give me one reason I should use this when there is Apache Nutch and it's free?
Re:A web crawler that can handle any number of websites on Wednesday April 12, 2017 @04:06PM (#14101247)
What's the largest crawl you can handle? meaning your upper limit...