News for hackers. Stuff that matters.

A comment on Improving API Response Times by Migrating from Cloud Functions to Cloud Run. Parent comment

Re:Improving API Response Times by Migrating from Cloud Func... by joek1301 on Wednesday January 12, 2022 @06:01PM (#29913978)
Obviously switching away from Cloud Functions does away with the architectural limitation of processing requests serially, but from my (limited) understanding of Node.js internals, Express applications are single-threaded anyway.

Do you have any idea of where your performance gains are coming from? Is there a lot of async, non-blocking waiting happening in the process of fulfilling requests against your API?

[ Parent | on HN ]
Re:Improving API Response Times by Migrating from Cloud Func... by obcilion on Thursday January 13, 2022 @02:27AM (#29917826)
The NodeJS application is single-threaded, but the Node EventLoop can handle a huge amount of parallel requests, especially since most of the time per request is spent waiting for calls to the DB or external APIs.

I believe the majority of our performance gain is from having far fewer cold starts during large traffic loads.

[ Parent | on HN ]