News for hackers. Stuff that matters.
Re:Smaller and faster data compression with Zstandard by wongarsu on Wednesday August 31, 2016 @03:17PM (#12400731)
Any modern server that handles a thousand or more concurrent connections on commodity hardware already uses only about as many threads as there are processor cores. In that architecture it's trivial to also limit the number of compression threads to the number of processor cores. That architecture gives the best performance and very low memory use.

In the mid-2000 it was still accepted norm to spawn one thread for each connection, where memory usage of the compressor would have been a problem. I doubt that it's a problem with today's software architecture.

Re:Smaller and faster data compression with Zstandard by _wmd on Wednesday August 31, 2016 @09:40PM (#12402672)
A server like this could only work by buffering an entire response before compressing it once, requiring (compressed+uncompressed) bytes temporary space. In reality most servers of the design you mention operate streamily, flushing the compressor's output just in time as the backend fills its input buffer. In designs like that (most of them) a compression context per connection is still required