Re:New for AWS Lambda: Use Any Programming Language and Shar...
by otterley on Thursday November 29, 2018 @01:31PM
(#18562514)
Cold start performance is improving significantly as the Lambda fleets migrate to Firecracker technology: https://aws.amazon.com/blogs/aws/firecracker-lightweight-vir...
[ Parent
| on HN ]
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by hn_throwaway_99 on Thursday November 29, 2018 @02:24PM
(#18563076)
Anyone know if there have been any improvements to cold start times for Lambdas in a VPC? That was the absolute death knell for us. If you're using Lambdas as a service backend for mobile/web apps, it's extremely common those Lambdas will be talking to a DB, and any decent security practice would require that DB to be in a VPC. Cold starts for Lambdas in a VPC could be on the order of 8-10 seconds: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-lat...
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by dopylitty on Thursday November 29, 2018 @06:02PM
(#18564987)
I just got out of a session at re:invent where they covered that they were working on improving VPC cold start times by reducing the amount of time it takes to associate an ENI with your lambda function. The method they're using also reduces the number of IPs needed to 1 per subnet.
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by Afraithe on Friday November 30, 2018 @04:39AM
(#18567894)
We recently had to abandon Lambdas, 10+ second cold start, and for some reason when adding an API Gateway you get another +200ms on each request (Google it, common issue apparently).
So, 10+ seconds cold start, and 200 + 200-300ms (around 500-600ms avg) calls to the Lambda function. Complete garbage for our application at least (I imagine using it for background processing might not be an issue with latency).
Switched over to EC2, less than 200ms response total, no cold starts.
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by djm_ on Thursday November 29, 2018 @05:52PM
(#18564932)
They're working on it, coming in 2019 (announced today) [1]
[1] https://twitter.com/jeremy_daly/status/1068272580556087296
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by staticassertion on Thursday November 29, 2018 @02:53PM
(#18563341)
Agreed! I'm much more concerned with VPC performance - I don't have a single lambda outside of a VPC. Firecracker is extremely cool, and I'm very glad to see the improved perf at the VM level, but that's not my bottleneck.
Thankfully, in my case, I have a very steady flow of data so I don't expect too many cold starts.
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by Tehnix on Thursday November 29, 2018 @08:27PM
(#18565835)
I know that they are actively looking at it.
One thing though, does your lambdas need both public and private access? Else you can place them in a subnet for private only, since the slow part is the ENI for the Nat Gateway.
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by staticassertion on Friday November 30, 2018 @02:03PM
(#18571640)
They all need to access S3, which I believe requires public.
Re:New for AWS Lambda: Use Any Programming Language and Shar...
by saosebastiao on Thursday November 29, 2018 @02:02PM
(#18562835)
Cold starts for the VM are only part of the problem. If you're on a JITed runtime, a cold start also means compilation and optimization. It would be nice if they had ways to cache the JITed machine code so they could start back up with it already compiled and optimized.