Re:Triv.io donates URL index to Common Crawl
by adventured on Tuesday January 08, 2013 @06:55PM
(#5029283)
You can get the top million sites from Quantcast in a download for free. Alexa used to also offer something similar, but I don't see it on their site any longer (they try to sell their data through aws, so that's probably why).
[ Parent
| on HN ]
Re:Triv.io donates URL index to Common Crawl
by ghewgill on Wednesday January 09, 2013 @01:34AM
(#5030501)
You can find the Alexa top 1 million domain list at http://www.alexa.com/topsites (it's on the right hand side).
Re:Triv.io donates URL index to Common Crawl
by gourneau on Tuesday January 08, 2013 @07:20PM
(#5029348)
Can someone dig that up and link it please
Re:Triv.io donates URL index to Common Crawl
by adventured on Tuesday January 08, 2013 @07:32PM
(#5029389)