News for hackers. Stuff that matters.
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by jbk on Saturday October 16, 2010 @12:57AM (#1797386)
Sorry, I don't get the fuss about this.

I do 1M pages/day in average since more than 1 year on one unique server that is a bi-opteron 250 at 2,4Ghz with a load average of 0.3...

We just serve mostly static content, and most php content is cached. I just think that this comparison to SO and /. is flawed.

Re:Minecraftwiki serving more traffic than Stackoverflow wit... by citricsquid on Saturday October 16, 2010 @08:19AM (#1797813)
Which wasn't our point, the OP here misrepresented us. We wanted to explain how popular we were and we realised we had as much traffic as stackoverflow, so we used that as a traffic comparison, our point was not to compare servers. As you can see if you read through the linked topic, at no point did we compare ourselves to SO beyond traffic wise, the OP here is at fault :)
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by Keyframe on Saturday October 16, 2010 @11:33AM (#1798113)
Why was your posted title on reddit then: "Minecraftwiki.net and minecraftforum.net now serve more traffic than Slashdot and Stackoverflow!" ? I just added a server count and php part which were both in the thread mentioned to signal previous false dichotomy. You guys shouldn't have posted a title like that then, you have compared yourself to SO and Slashdot, not me.
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by citricsquid on Saturday October 16, 2010 @11:56AM (#1798155)
Yes, we compared our traffic levels, not our server count. The title of this post implies that we're saying "we have as much traffic as SO and they use more servers!" which wasn't the point. The point was Stackoverflow is a tangible comparison of traffic, not hardware. Anyway I replied to you above explaining, I misunderstood your intentions.

Your title made our servers and setup the focus, that wasn't the point at all.

Re:Minecraftwiki serving more traffic than Stackoverflow wit... by necro on Saturday October 16, 2010 @02:56AM (#1797513)
I agree. Over here we do 70m (high write ratio) pages per month on 1 server handling all apache/php/mysql. Hardware is really fast these days if you tune it to any degree.

Heck, if we're showing off, here is how we do it...pretty graphs and all. http://www.pinkbike.com/news/pinkbike-speed-efficiency.html

Re:Minecraftwiki serving more traffic than Stackoverflow wit... by StavrosK on Saturday October 16, 2010 @08:35PM (#1799260)
That was a very interesting article, thanks. One question, if I may: When using a reverse proxy, it makes no sense to have keepalives on for Apache, correct? The proxy takes care of the keepalive and leaves Apache free for other requests?
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by necro on Friday October 22, 2010 @07:21PM (#1821916)
Correct. The reverse proxy pulls from the fast, local network apache, and then passed the data to the slow clients. Apace is connected for a shorter time. Basically you're trying minimize the time a "memory expensive" process like apache is open per client.
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by StavrosK on Friday October 22, 2010 @08:43PM (#1822122)
Yep, makes perfect sense, thank you. I've disabled keepalive and increased my mancrush on varnish.
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by petdog on Saturday October 16, 2010 @07:40AM (#1797774)
Could you expand on the tuning of tcp slow start? Are you referring to net.ipv4.tcp_slow_start_after_idle?
Re:Minecraftwiki serving more traffic than Stackoverflow wit... by necro on Saturday October 16, 2010 @11:05AM (#1798061)
No, I'm not referring to this parameter in the write up. ipv4.tcp_slow_start_after_idle, which is on by default on most distros, applies to keepalive connections. This causes your keepalive connection to return to slow start after TCP_TIMEOUT_INIT which is 3 seconds. Not probably want you want or expect. For example, if you have keepalives of say 10s, you'd expect that a request after say 5s would have it's congestion window fully open from previous requests, but the default behaviour is to go back to slow start, and close your congestion window back down. So you want to tune this to off on your image servers and other keepalive systems.

The tuning which I talk about is to actually increase the default initial congestion window size. The result being an advantage for non-keepalive connections and keepalives. There is no sysctl parameter that will allow for this control. This behaviour is hardcoded into the tcp stack, and hence requires direct modification and a recompiled kernel.

Re:Minecraftwiki serving more traffic than Stackoverflow wit... by Rantenki on Saturday October 16, 2010 @01:21PM (#1798327)
This is a really good intro on tuning a high bandwidth site; thx!