Ask HN: What is your high performance server setup?

Posted by hmm-interesting on Friday August 12, 2022 @02:24PM
from the ask-hn dept.

https://news.ycombinator.com/item?id=32439601

After reading this, I am wondering, how do you configure your linux server for high throughput API? I am struggling with 10k concurrent request with node.js on c6i.4xlarge and one ElastiCache redis cluster. I can't imagine handling 50k/100k concurrent request with single server.

( 3 comments | on HN )

Re:Ask HN: What is your high performance server setup? by minhmeoke on Saturday August 13, 2022 @01:57AM (#32447305)

Profile your server and figure out what the bottleneck in your app is: https://nodejs.org/en/docs/guides/simple-profiling/

Also, consider building the ElasticSearch index on another server than the one serving live traffic.

[ Parent | on HN ]

Re:Ask HN: What is your high performance server setup? by icedchai on Friday August 12, 2022 @03:14PM (#32442790)

Are you maxing out all cores? Perhaps try running multiple processes.

[ Parent | on HN ]

Re:Ask HN: What is your high performance server setup? by hmm-interesting on Friday August 12, 2022 @03:32PM (#32442948)

Yes (using pm2). I have a very good performance (req/sec) for 100/200 concurrent request. But it is a disaster for high concurrent requests.

[ Parent | on HN ]