Prime Video Abandons Serverless Distributed Stack for Monolith, saves 90%

Re:Prime Video Abandons Serverless Distributed Stack for Mon... by easton on Thursday May 04, 2023 @06:10AM (#35813268)

The only problem with that is that Docker lambdas boot slower than lambdas with the built in runtime (not ridiculously slow, but could be 2x or something). God help you anyway if you’re trying to do something latency sensitive on Lambda, but if you are then you probably don’t want to add more time for a docker pull.

[ Parent | on HN ]

Re:Prime Video Abandons Serverless Distributed Stack for Mon... by Jochim on Thursday May 04, 2023 @01:50PM (#35819426)

I used to believe the same thing, I've began thinking it might now be false yet often repeated. AWS claims that:

> Lambda also optimizes the image and caches it close to where the functions runs so cold start times are the same as for .zip archives.[0]

This[1] article shows almost no discernable difference in .NET cold start times between containerised and regular lambdas.

It's easy to imagine developers pushing up bloated images, slowing startup down and blaming docker/AWS for it.

[0] https://aws.amazon.com/blogs/compute/working-with-lambda-lay...

[1] https://www.kloia.com/blog/aws-lambda-container-image-.net-b...

[ Parent | on HN ]

Re:Prime Video Abandons Serverless Distributed Stack for Mon... by re-thc on Sunday May 07, 2023 @02:46AM (#35848580)

The situation does keep changing - AWS does optimize things.

I'm not so sure it's a black/white true/false. Depends on what goes in the docker image. It's something like for larger deployments docker is faster but for small deployments it's the other way.

[ Parent | on HN ]

Re:Prime Video Abandons Serverless Distributed Stack for Mon... by squeaky-clean on Thursday May 04, 2023 @04:01PM (#35821285)

We've actually observed the opposite at our company. Moving from a Python 3.8 built-in to Docker based changed our response times from about 40ms to 30ms on average.

[ Parent | on HN ]