News for hackers. Stuff that matters.
Re:I just finished crawling 5.19B web pages, Ask Me Anything by dor_jack on Wednesday April 19, 2017 @07:08PM (#14152586)
It took us about 13 days. We recorded reources of all types: text/, image/, application/*

As one would expect the vast majority of data recorded is text/* (html,...)

There are no comments on this comment yet.