News for hackers. Stuff that matters.
Re:The C10K problem by theknown99 on Monday February 17, 2014 @04:16AM (#7251230)
Not really true unless you use crappy software.

I run a few thousand simultaneous connections on AWS small instances without any issues. (HTTP + HTTPS).

The key is writing good software. Which a lot of programmers are still really bad at.

Re:The C10K problem by pyalot2 on Monday February 17, 2014 @04:31AM (#7251260)
You know, it's cute when somebody who wasn't even born when I started writing software for servers tries to discredit me.
Re:The C10K problem by theknown99 on Monday February 17, 2014 @05:38AM (#7251418)
It's cute when you make ridiculous assumptions about when people were born.

Lets stick to the facts...

You stated that Amazon instances couldn't cope. They can. They can cope just fine with thousands of simultaneous HTTP and HTTPS connections. If you can't get your amazon instance to do this, you're using crappy software.

> "The 10k problem is still not solved. A run of the mill VPS typically manages around 1k simultaneous connections and 10k requests/s. That is, over plain http. Over TLS this goes down to about 100 connections and 600 requests/s. A cheap amazon instance will usually be around 1/5th of all that."

Where the hell are you getting those poor figures from? Are you using Lisp or something?

> "and the prevalent implementation (OpenSSL) is not written for high performance servers (it basically dictates that you run blocking sockets in a thread per connection)."

Again - you're using crappy software. Don't use it.

The 10k problem is historically interesting, but for anyone who knows how to program, it's not really an issue.

Re:The C10K problem by pyalot2 on Monday February 17, 2014 @05:47AM (#7251446)
If you use anything like Apache, lighttpd, Cherokee, Nginx, Tux, etc. they all use OpenSSL, and nothing else.
Re:The C10K problem by theknown99 on Monday February 17, 2014 @08:51AM (#7252045)
Well don't use them then!

Seriously. Writing a webserver isn't a big job. It's not very hard to program something that runs better than the ones you list, for specific use cases.

Re:The C10K problem by pyalot2 on Monday February 17, 2014 @11:09AM (#7252687)
Been there done that, but the fact is, there is no alternative to OpenSSL I could see if you want to have SSL/TLS 1.1, 1.2 and 1.3.
Re:The C10K problem by vidarh on Tuesday February 18, 2014 @04:44AM (#7257237)
Any reason why none of the open implementations listed here are suitable:

http://en.wikipedia.org/wiki/Comparison_of_TLS_implementatio...

?

Re:The C10K problem by theknown99 on Monday February 17, 2014 @12:04PM (#7252973)
If only there was a way to replace the functionality provided by OpenSSL, by writing some code :(
Re:The C10K problem by pyalot2 on Monday February 17, 2014 @05:10PM (#7254859)
To rewrite OpenSSL you'll need to be a security and cryptography programmer. And even if you are, the task is daunting to say the least.
Re:The C10K problem by rbanffy on Monday February 17, 2014 @05:14AM (#7251353)
It would be better if you both gave more details on what and how you do so the possible mistakes from both sides could be pointed out and we could learn from them.

From a quick glance on your post, I too suspect there is something wrong - your performance shouldn't be that bad, but there is not enough information to point where.

Re:The C10K problem by pyalot2 on Monday February 17, 2014 @05:27AM (#7251387)
That's really too long to list, I could conceivably write a book about it.

But, fortunately it's relatively easy to test. You get whatever server you prefer, and install nginx and install a bunch of performance testing tools (like siege, ab etc.) and then you test different concurrency load scenarios.

No custom software, and widely regarded the fastest webserver out there.

Re:The C10K problem by rbanffy on Monday February 17, 2014 @05:30AM (#7251396)
As I pointed elsewhere, most recent servers are just overgrown IBM 5150 PCs, with much faster CPUs, immense amounts of memory and storage and somewhat faster buses. They are desktop PCs misused as servers.
Re:The C10K problem by theknown99 on Monday February 17, 2014 @05:40AM (#7251423)
> and install nginx

Yeah there's your problem...

Re:The C10K problem by pyalot2 on Monday February 17, 2014 @05:51AM (#7251454)
You can replicate the exact same experience (only worse) with any other webserver like apache, lighttpd, cherokee, etc.

Tux may be a bit faster, but it can't serve dynamic content nearly as fast as it serves files, so that's pretty much useless.

Re:The C10K problem by rbanffy on Monday February 17, 2014 @06:43AM (#7251596)
Have you tried other operating systems?
Re:The C10K problem by theknown99 on Monday February 17, 2014 @08:49AM (#7252038)
Have you tried writing your own webserver? Then tuning it to your particular use case?
Re:The C10K problem by pyalot2 on Monday February 17, 2014 @11:08AM (#7252679)
Yes
Re:The C10K problem by theknown99 on Monday February 17, 2014 @11:59AM (#7252953)
hmm so I've written a webserver and am able to get thousands of concurrent requests on a small amazon instance without issues.

And you've written a webserver and you can't.

Interesting...

Re:The C10K problem by rbsn on Monday February 17, 2014 @06:30PM (#7255230)
Can we see your results?