Re:Nginx now within 1% of IIS's Active Site Market Share
by JonoW on Tuesday November 08, 2011 @10:41AM
(#3211124)
Question; how does netcraft determine what web-server serves a particular domain? Most big sites hide those details in http headers, so how do they tell?
[ Parent
| on HN ]
Re:Nginx now within 1% of IIS's Active Site Market Share
by hbar on Tuesday November 08, 2011 @10:53AM
(#3211182)
...Read the HTTP headers? I think you answered your own question.
Re:Nginx now within 1% of IIS's Active Site Market Share
by maw on Tuesday November 08, 2011 @11:09AM
(#3211266)
I think GP meant that they hide that info even in their headers, such that you can't just see what's in Server:.
Re:Nginx now within 1% of IIS's Active Site Market Share
by JonoW on Tuesday November 08, 2011 @11:21AM
(#3211316)
As @maw said, most top sites remove the http headers that identify the web-server. Also, if you had to take the top, I don't know, 10k sites by traffic, I would imagine all of them use a load-balancer, so how can netcraft know what the web-server is behind them?
Re:Nginx now within 1% of IIS's Active Site Market Share
by chc on Tuesday November 08, 2011 @11:47AM
(#3211461)
Top sites? I think probably a few of these would quality:
CNN.com — Server: nginx
Netflix.com — Server: Apache-Coyote/1.1
YouTube.com — Server: Apache
Wikipedia.com — Server: Apache
Twitter.com — Server: tfe
LinkedIn.com — Server: Apache-Coyote/1.1
Granted, this does not give you a good picture of their network topology, but in general they do report something that Netcraft can use.
Re:Nginx now within 1% of IIS's Active Site Market Share
by mst on Tuesday November 08, 2011 @01:19PM
(#3211982)
Right. The version is often stripped out, but the server software tends to stay in there.
Totally possible there's extra heuristics in there though; I totally can't remember from when I ran that thing but it took about a week to run and spent most of its time waiting on other people's servers, so burning a bunch more CPU doing extra analysis wouldn't cause Netcraft any issue at all, I don't think.