Re:Serverless: Cold Start War
by abalone on Tuesday September 11, 2018 @12:27PM
(#17961168)
> Yes, one could prewarm N instances by sending N parallel requests every 5 minutes.
Uhh.. you’re just speculating here right? I seriously doubt Lambda spins up a whole new container for every single “parallel” request in a short burst. There’s probably a little bit of queuing and/or they aren’t exactly parallel.
I think it’s something the vendors need to solve, like by directly prewarming prior to throwing traffic at it.
Re:Serverless: Cold Start War
by mikestaub on Tuesday September 11, 2018 @08:47PM
(#17964712)
I agree the vendors needs to solve this. In the meantime I think you can hack it by using Kinesis shards ( one lambda per shard ) if you know you will need many lambdas in advance. https://github.com/awslabs/aws-lambda-kinesis-prewarming
Uhh.. you’re just speculating here right? I seriously doubt Lambda spins up a whole new container for every single “parallel” request in a short burst. There’s probably a little bit of queuing and/or they aren’t exactly parallel.
I think it’s something the vendors need to solve, like by directly prewarming prior to throwing traffic at it.
Oh and thank you for the detailed post!