News for hackers. Stuff that matters.
Re:The 1000 most-visited sites on the web (by Google) by latch on Friday May 28, 2010 @10:03AM (#1386419)
I extracted the data, added IP, country and response headers, and dumped it into a usable format:

http://openmymind.net/top1000data.txt

You can do some decently interesting analysis..like the fact that nginx is the front-end for nearly as many sites as IIS.

Re:The 1000 most-visited sites on the web (by Google) by lazyant on Friday May 28, 2010 @06:43PM (#1387879)
Thanks for the data.

"nginx is the front-end for nearly as many sites as IIS", oh I wished that was true but according to my naive counting IIS is over 3 times more popular, am I missing something?:

$ wget http://openmymind.net/top1000data.txt

$ grep -c '"Server": "nginx"' top1000data.txt

39

$ grep -c '"Server": "Microsoft-IIS' top1000data.txt

149

Re:The 1000 most-visited sites on the web (by Google) by ireadzalot on Friday May 28, 2010 @01:08PM (#1386998)
Could you share how you extracted the data? I thought it was nifty that way you have it in that txt file. Thanks.
Re:The 1000 most-visited sites on the web (by Google) by sonnyz on Friday May 28, 2010 @12:51PM (#1386950)
Why is dropbox 'myth and folklore'???
Re:The 1000 most-visited sites on the web (by Google) by latch on Friday May 28, 2010 @01:08PM (#1386997)
The categories of the json dump come directly from the original google source..so i don't know (and dropbox certainly isn't the only mis-categorized entry):

http://www.google.com/adplanner/static/top1000/

Re:The 1000 most-visited sites on the web (by Google) by rmorrison on Friday May 28, 2010 @01:05PM (#1386988)
Oh god, and I've been trusting them w/ my backups!!!!!
Re:The 1000 most-visited sites on the web (by Google) by sosuke on Friday May 28, 2010 @10:36AM (#1386516)
Over what time period is pageviews calculated on?
Re:The 1000 most-visited sites on the web (by Google) by latch on Friday May 28, 2010 @10:54AM (#1386555)
The page views is pulled from the original google list. They have more information at: http://www.google.com/support/adplanner/bin/answer.py?hl=en&...

They don't say what time frame page view is, but they do say unique visits is over the course of 1 month - so its probably safe to assume page view is also over 1 month.

Re:The 1000 most-visited sites on the web (by Google) by jpdbaugh on Friday May 28, 2010 @10:23AM (#1386470)
They must have filtered porn. There is no way redtube.com is not in the top 100.
Re:The 1000 most-visited sites on the web (by Google) by sucuri2 on Friday May 28, 2010 @10:27AM (#1386485)
They did: " Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites. "
Re:The 1000 most-visited sites on the web (by Google) by jcl on Friday May 28, 2010 @11:29AM (#1386656)
A curious list of restrictions... I wonder what kind of site would be in the top 1000 that didn't have publicly visible content or load properly? Pure Flash sites, maybe?
Re:The 1000 most-visited sites on the web (by Google) by papachito on Friday May 28, 2010 @12:50PM (#1386946)
Alexa has a top 500 list with google and porn sites included http://www.alexa.com/topsites
Re:The 1000 most-visited sites on the web (by Google) by jpdbaugh on Friday May 28, 2010 @01:35PM (#1387071)
Sorry! I must have missed that.
Re:The 1000 most-visited sites on the web (by Google) by remi on Friday May 28, 2010 @10:06AM (#1386427)
Re:The 1000 most-visited sites on the web (by Google) by petercooper on Friday May 28, 2010 @11:36AM (#1386680)
Not sure why that's not the main link here instead of a useless blog article that removes half the data and adds no insight or extra information whatsoever.. :-)
Re:The 1000 most-visited sites on the web (by Google) by portman on Friday May 28, 2010 @12:36PM (#1386894)
Amazing that Facebook has ONE THOUSAND pageviews per unique visitor compared to about 100 pageviews per unique visitor on the rest of the sites.
Re:The 1000 most-visited sites on the web (by Google) by rayvega on Friday May 28, 2010 @11:24AM (#1386642)
# 824 stackoverflow vs # 994 expertsexchange

Perhaps another confirmation of what the SO folks have been saying about their popularity.

Re:The 1000 most-visited sites on the web (by Google) by petercooper on Friday May 28, 2010 @11:37AM (#1386687)
Note that StackOverflow is listed as being in the "Music" category :-) Wha..?
Re:The 1000 most-visited sites on the web (by Google) by cadr on Friday May 28, 2010 @11:47AM (#1386725)
I always go to StackOverflow to find out what the kids are listening to these days.
Re:The 1000 most-visited sites on the web (by Google) by sucuri2 on Friday May 28, 2010 @10:01AM (#1386412)
#20 - ask.com #252 - digg.com #261 - justin.tv

Reddit not in the list... What I don't understand is how come sites like openoffice.org, kaspersky.com, mcafee.com are so high in the list. Do people really visit them that often?

Re:The 1000 most-visited sites on the web (by Google) by CapitalistCartr on Friday May 28, 2010 @10:08AM (#1386432)
It's more likely that their computer does. For stuff like Auto-updates.
Re:The 1000 most-visited sites on the web (by Google) by lftl on Friday May 28, 2010 @10:36AM (#1386517)
Ahh that probably explains counduit.com at #29 as well.
Re:The 1000 most-visited sites on the web (by Google) by michaelbuckbee on Friday May 28, 2010 @01:01PM (#1386980)
And likely HP.com as well. Stupid printer drivers.
Re:The 1000 most-visited sites on the web (by Google) by michaelbuckbee on Friday May 28, 2010 @01:03PM (#1386985)
Given how inaccurate the categorizations are I think it's possible that Reddit got put in the "adult" category.
Re:The 1000 most-visited sites on the web (by Google) by pg on Sunday May 30, 2010 @01:47AM (#1390068)
Anyone care to do a scatterplot of domain name length vs rank?
Re:The 1000 most-visited sites on the web (by Google) by tewks on Sunday May 30, 2010 @07:23AM (#1390344)
It looks somewhat periodic:

http://images.rdujour.com/wp-content/uploads/2010/05/domainL...

I did not include the length of the tld.

Re:The 1000 most-visited sites on the web (by Google) by tewks on Sunday May 30, 2010 @12:13PM (#1390656)
Monthly uniques versus domain name length:

http://images.rdujour.com/wp-content/uploads/2010/05/uniques...

Re:The 1000 most-visited sites on the web (by Google) by icey on Friday May 28, 2010 @11:47AM (#1386724)
Depressingly, Mahalo is on the list (#946).
Re:The 1000 most-visited sites on the web (by Google) by trun on Friday May 28, 2010 @09:56AM (#1386398)
Dropbox on the list at 985. Impressive.
Re:The 1000 most-visited sites on the web (by Google) by darien on Friday May 28, 2010 @10:30AM (#1386499)
But reddit.com is nowhere to be seen... surprising.
Re:The 1000 most-visited sites on the web (by Google) by drats on Friday May 28, 2010 @11:19AM (#1386622)
My question is, if reddit were on that list, would the moderation system be able to prevent it turning into Digg? I don't think it could, although maybe the subreddit system could. Places like /r/politics/ are fairly useless for intelligent debate already. Such link sharing sites don't have the same "my friends are there" grounding force that Facebook has, it's just the "vibe" and community so running away to a new site is easily mounted.
Re:The 1000 most-visited sites on the web (by Google) by petercooper on Friday May 28, 2010 @11:39AM (#1386694)
And listed as a "Myth and Folklore" site. I wonder who came up with these "categories" - there are some crazy assignments in the list.
Re:The 1000 most-visited sites on the web (by Google) by sucuri2 on Friday May 28, 2010 @10:26AM (#1386477)
Did you guys notice Wordpress.com and .org in there:

.com: 120,000,000 uniques

.org: 8,100,000 uniques

Impressive.

Re:The 1000 most-visited sites on the web (by Google) by larryfreeman on Friday May 28, 2010 @04:02PM (#1387489)
Keep in mind that the numbers listed are estimations.

For example, HubPages, the site where I work, is listed at #270 with 11M unique visitors and 97M page views.

Our monthly absolute unique visitors (according to Google Analytics) is more than three times that. Our monthly page views are greater than 100M.

Re:The 1000 most-visited sites on the web (by Google) by monos on Friday May 28, 2010 @10:12AM (#1386444)
"...as measured by Ad Planner."

the list is a decent guesstimate. unless every single site on the planet uses the facebook like button, google analytics, google ads, or something else that tracks globally, there is now way to correctly measure UC or PI.

Re:The 1000 most-visited sites on the web (by Google) by jhaglund on Sunday May 30, 2010 @01:43AM (#1390064)
it reassures me that foxnews.com is farther down than I would have expected.

43. http://bbc.co.uk 83. http://nytimes.com 179. http://reuters.com 257. http://foxsports.com 279. http://foxnews.com

Re:The 1000 most-visited sites on the web (by Google) by dolinsky on Friday May 28, 2010 @10:38AM (#1386521)
Mashable - #696 Techcrunch - #850. Nice to see I'm not the only one that prefers Cashmore to Arrington.
Re:The 1000 most-visited sites on the web (by Google) by ElbertF on Saturday May 29, 2010 @09:42PM (#1389671)
Why? All Mashable does is post about Twitter trends and recycle Techcrunch posts a week later.
Re:The 1000 most-visited sites on the web (by Google) by arst on Friday May 28, 2010 @11:56AM (#1386755)
I really doubt that usgs.gov (#978) gets anywhere near the number of visits that nfl.com gets (#993).
Re:The 1000 most-visited sites on the web (by Google) by ojbyrne on Friday May 28, 2010 @12:06PM (#1386778)
Everytime there's an earthquake in California, half the state goes there.
Re:The 1000 most-visited sites on the web (by Google) by wheaties on Friday May 28, 2010 @12:34PM (#1386886)
Wow, yahoo is up there. It's a shame they can't monetize their websites more.
Re:The 1000 most-visited sites on the web (by Google) by ThomPete on Friday May 28, 2010 @02:36PM (#1387279)
I think their problem is that they are to big an operation. They probably could be if they trimmed the company.
Re:The 1000 most-visited sites on the web (by Google) by zandorg on Friday May 28, 2010 @11:29AM (#1386657)
Geocities still running in Japan after being shut down in the west? Wierd!
Re:The 1000 most-visited sites on the web (by Google) by alexyim on Friday May 28, 2010 @12:51PM (#1386951)
It's interesting how hard it is to come up with http://windows.com even though I tried explicitly searching for it
Re:The 1000 most-visited sites on the web (by Google) by volida on Friday May 28, 2010 @10:38AM (#1386522)
where s youtube?
Re:The 1000 most-visited sites on the web (by Google) by jcl on Friday May 28, 2010 @11:35AM (#1386675)
"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites."
Re:The 1000 most-visited sites on the web (by Google) by hokkos on Friday May 28, 2010 @10:59AM (#1386572)
where is google in that list ?
Re:The 1000 most-visited sites on the web (by Google) by bond on Friday May 28, 2010 @12:34PM (#1386887)
"Keep in mind that the list excludes adult sites, ad networks, domains that don't have publicly visible content or don't load properly, and certain Google sites." reply
Re:The 1000 most-visited sites on the web (by Google) by retube on Friday May 28, 2010 @11:28AM (#1386649)
the daily mail at 236 aarrgghhhhh!!!!!!!
Re:The 1000 most-visited sites on the web (by Google) by rokhayakebe on Friday May 28, 2010 @10:58AM (#1386570)
Scribd 102. Excellent. I would like to know how much financing each one of those site took to date.
Re:The 1000 most-visited sites on the web (by Google) by ori_b on Friday May 28, 2010 @11:17AM (#1386615)
google isn't on that list?
Re:The 1000 most-visited sites on the web (by Google) by nkassis on Friday May 28, 2010 @01:25PM (#1387037)
where is slashdot?