News for hackers. Stuff that matters.
Re:Triv.io donates URL index to Common Crawl by adventured on Tuesday January 08, 2013 @06:55PM (#5029283)
You can get the top million sites from Quantcast in a download for free. Alexa used to also offer something similar, but I don't see it on their site any longer (they try to sell their data through aws, so that's probably why).
Re:Triv.io donates URL index to Common Crawl by ghewgill on Wednesday January 09, 2013 @01:34AM (#5030501)
You can find the Alexa top 1 million domain list at http://www.alexa.com/topsites (it's on the right hand side).
Re:Triv.io donates URL index to Common Crawl by gourneau on Tuesday January 08, 2013 @07:20PM (#5029348)
Can someone dig that up and link it please
Re:Triv.io donates URL index to Common Crawl by adventured on Tuesday January 08, 2013 @07:32PM (#5029389)