News for hackers. Stuff that matters.
Re:Serverless: Cold Start War by isuckatcoding on Tuesday September 11, 2018 @01:43AM (#17957430)
I feel as if the whole "warm up the lamba as a pre-step"-thing takes away from the whole benefit of serverless. I wonder if AWS Lambda could be smart enough to anticipate requests based on some historical or daily pattern. Also, I'd be curious to know if it is still cost effective to use lambda with this technique (pre-warming) or to straight up go for a EC2 instance.
Re:Serverless: Cold Start War by stephenr on Tuesday September 11, 2018 @03:00AM (#17957689)
Or.. you know.. don't have user-facing interfaces serviced by endpoints that aren't running all the time?

I can see that maybe there is a case to make for using functions as a service, to handle batch processing of things, or possibly to service background API requests.

Re:Serverless: Cold Start War by TrueTeller on Tuesday September 11, 2018 @03:06AM (#17957706)
1. Most applications don't need the warm-up since they aren't too critical to cold starts.

2. Cloud vendors are working and succeeding to make cold starts faster, and AWS is at the forefront.

3. Pre-warming done right is extremely cheap, you won't pay anything meaningful, just several cents per month.

P.S. I'm the author of OP.

Re:Serverless: Cold Start War by jacques_chester on Tuesday September 11, 2018 @07:49AM (#17958810)
> I wonder if AWS Lambda could be smart enough to anticipate requests based on some historical or daily pattern.

This is called "predictive autoscaling". In other fields it's called seasonality and you can build inventory and manufacturing plans around it.

While researching FaaSes last year I saw a slide deck from an Amazon PM about Lambda (I promptly lost the link). The thing that stuck with me was a claim that a substantial amount of their autoscaling "magic" was due to predictive autoscaling.

Netflix wrote up[1][2], but have not opensourced, their predictive autoscaler "Scryer" in a few blog posts. The tl;dr is that they use a combination of fourier transforms and simple correlations to make a basic forecast of how many VMs to have ready at different times of day. A reactive autoscaler adjusts on the day.

[1] https://medium.com/netflix-techblog/scryer-netflixs-predicti...

[2] https://medium.com/netflix-techblog/scryer-netflixs-predicti...