News for hackers. Stuff that matters.
Re:Nxweb – Fast and Lightweight Web Server by geocar on Saturday February 27, 2016 @04:37AM (#11186635)
> Technically, there's no good reason why a FastCGI based system would be significantly slower than a custom reimplementation like this.

An HTTP server speaking to a FastCGI application will:

• read the HTTP message

• decode HTTP

• encode FastCGI

• write to application

The FastCGI application will then:

• read the FastCGI message

• decode the FastCGI message

• do application stuff

• encode the FastCGI response

• write to the web server

The webserver then resumes:

• reading the FastCGI response

• decoding the FastCGI response

• writing the HTTP response

Meanwhile, an in-process HTTP server (like nxweb) system will simply:

• read the HTTP message

• decode HTTP

• do application stuff

• write the HTTP response

Less code runs faster; it is obvious to me why this is faster.

Re:Nxweb – Fast and Lightweight Web Server by iMerNibor on Saturday February 27, 2016 @05:37AM (#11186734)
I'd imagine encoding/decoding will be really insignificant compared to generating the requested page or fetching data from a database in most, if not all, cases
Re:Nxweb – Fast and Lightweight Web Server by geocar on Saturday February 27, 2016 @06:09AM (#11186785)
Most websites do not see more than 100 requests per second.

In those cases you are correct: parsing and de-parsing is insignificant compared to the amount of energy the computer is using to heat the room.

However in order to do a trillion requests per day you need around 30 machines using a custom web server, or 300 machines using Fastcgi: In this situation the cost is an order of magnitude.

Re:Nxweb – Fast and Lightweight Web Server by jerf on Saturday February 27, 2016 @10:14AM (#11187264)
Many people observe that as miles-per-gallon gets better and better, it begins to become a deceptive measurement in a way, because going from 10 to 20 mpg is a much, much larger change than going from 30 to 40, or even from 80 to 140. It seems people get a better sense of what's going on to measure gallons per mile. When you start doing that it becomes more clear that going from .0001 gallons per mile to .00001 gallons per mile, as large as it may be in orders of magnitude, still isn't that big a deal. Either way you're looking at your cost-of-fuel being effectively zero for all practical use cases, because your costs will be dominated by something else.

Similarly, I've noticed that people tend to get a little silly about web server requests-per-second. It really gets to the point you probably ought to be talking about seconds per request, or perhaps rather, microseconds per request or something.

Because A: as you start talking about these fast servers, you need to contemplate whether your code can run in, say, 2.5 microseconds either; who cares whether your webserver takes 2 or 25 microseconds to handle a minimal request if your minimal response requires 8 milliseconds (i.e. "8000 microseconds")? 8ms would actually be pretty decent performance for a wide variety of non-trivial web requests.

And B: As the webservers get faster and faster, you really need to start wondering what corners they cut to push their reqs/s number up. I can make a blazingly fast webserver that would actually kill nginx's performance stone dead for a "return a constant JSON string response" task... the trick is that I'm not even going to look at the incoming web request, I'm going to just receive a socket, blast out my answer as a constant string buffer without even reading from the socket, and discard the socket. (If you're feeling particularly saucy, hook that up to a user-space TCP stack so you can drop the work of properly setting up and tearing down TCP connections.) There aren't that many real-world tasks for which that is a good solution (though, non-zero!), but it'll look like pure awesomesauce on the benchmark!

Properly handling HTTP is non-trivial problem, and even moreso if it's going to be hooked up to a program rather than a static file system or something similarly easy. I actually start getting nervous about web servers that show excessively high numbers. If your performance is much better than nginx, rather than me cheering for joy, I actually have a lot of questions about how you did that exactly, and what my website's security profile looks like with your way-faster server. I'm not saying these questions are completely unanswerable; perhaps there is a way to safely do a much faster web server. I'm just saying that rather than my default response being celebration and "Oh wowzers cool!", my default reaction is a healthy dollop of skepticism.

Re:Nxweb – Fast and Lightweight Web Server by rkeene2 on Saturday February 27, 2016 @12:47PM (#11187790)
My web server, filed ( http://filed.rkeene.org/ ), is faster than nginx for serving static content by doing two things: 1. Only handling static files 2. Being extremely optimized for serving static content

It's very safe as far as I can tell having run it under AFL with no crashes with ASan on as well as having run it in production on the public Internet.

A few of the optimizations I do in "filed" could also be done in nginx, but most would cost too much.

A separate logging thread that is queued to helps a lot and was one of the main reasons for writing "filed" -- my ability to serve files was being slowed by my ability to write logs indicating that I had served something. The downside is that there may be a large queue of unwritten logs in the event of a kernel panic it other unexpected process termination.

Most requests don't even open the file they are serving because "filed" caches open file descriptors -- once the file has been opened it's kept open until cache entry is needed for a newer file.

There are no runtime allocations after startup except for log entries, leading to very consistent performance under loads.

Re:Nxweb – Fast and Lightweight Web Server by JoeAltmaier on Saturday February 27, 2016 @10:19AM (#11187280)
Re: gallons of gas. There's the old puzzle: your spouse gets 100MPG in that super-hybrid-mobile. The salesperson wants to upgrade you for $1000 to the super-duper-hybrid-mobile at 200MPG! Double the mileage!

You suggest instead that you get the old truck serviced and replace the plugs, distributor and tailpipe. Estimated cost $1000, and should get you from 10MPG to 11MPG. Which is the better deal? Assuming you both drive about 100 miles per week.

Re:Nxweb – Fast and Lightweight Web Server by zzzcpan on Saturday February 27, 2016 @11:05AM (#11187455)
Web servers are not like that. Micro-optimizations only work for benchmarks and very specific load patterns that almost no people have.
Re:Nxweb – Fast and Lightweight Web Server by hueving on Saturday February 27, 2016 @12:41PM (#11187765)
Isn't it precisely like that? The point of the exercise is that even when you are getting really high mpg changes (e.g. 100 to 120), the best gain is improving the the really slow component of the pipeline (e.g. the truck from 10 to 12).
Re:Nxweb – Fast and Lightweight Web Server by zzzcpan on Saturday February 27, 2016 @01:59PM (#11188004)
Well, no. Web server's role is more like a taxi drive home after a 12 hour flight. From that perspective MPGs don't matter at all.
Re:Nxweb – Fast and Lightweight Web Server by geocar on Saturday February 27, 2016 @11:50AM (#11187591)
That is a very good point, but it's not the argument here: I'm responding specifically to the idea that webserver and webserver+fastcgi are "technically" the same speed.

Running two web servers (one speaking HTTP and one speaking FastCGI) is necessarily going to be slower than running one web server.

This should be obvious, although it might be "not significantly slower", which is why I provided some real numbers from my experience to show at which point it becomes slower by an order of magnitude.

You might also find that it's easier to debug one webserver than two.

Re:Nxweb – Fast and Lightweight Web Server by hueving on Saturday February 27, 2016 @12:35PM (#11187745)
I don't see how it can become an order of magnitude slower even if your app is effectively a no-op. Two extra fast cgi encodes and decodes sounds like the whole pipeline is just doing 3x the serialization of a non-fast cgi one. Am I missing some context switching overhead you are implying or something?
Re:Nxweb – Fast and Lightweight Web Server by mhd on Saturday February 27, 2016 @07:36AM (#11186930)
If you managed to get a trillion requests per day with a "hello world" scenario, you're probably also able to get 270 machines for free from your gullible incubator.
Re:Nxweb – Fast and Lightweight Web Server by geocar on Saturday February 27, 2016 @07:46AM (#11186949)
Most ad servers deliver static or hello-world-style content, doing no database lookups, but logging their results.

RTB systems have about 30-100msec for the entire transaction (and that includes network to the user), so you need better control of your latency anyway.