Re:Serverless: Cold Start War
by jacques_chester on Tuesday September 11, 2018 @07:49AM
(#17958810)
> I wonder if AWS Lambda could be smart enough to anticipate requests based on some historical or daily pattern.
This is called "predictive autoscaling". In other fields it's called seasonality and you can build inventory and manufacturing plans around it.
While researching FaaSes last year I saw a slide deck from an Amazon PM about Lambda (I promptly lost the link). The thing that stuck with me was a claim that a substantial amount of their autoscaling "magic" was due to predictive autoscaling.
Netflix wrote up[1][2], but have not opensourced, their predictive autoscaler "Scryer" in a few blog posts. The tl;dr is that they use a combination of fourier transforms and simple correlations to make a basic forecast of how many VMs to have ready at different times of day. A reactive autoscaler adjusts on the day.
This is called "predictive autoscaling". In other fields it's called seasonality and you can build inventory and manufacturing plans around it.
While researching FaaSes last year I saw a slide deck from an Amazon PM about Lambda (I promptly lost the link). The thing that stuck with me was a claim that a substantial amount of their autoscaling "magic" was due to predictive autoscaling.
Netflix wrote up[1][2], but have not opensourced, their predictive autoscaler "Scryer" in a few blog posts. The tl;dr is that they use a combination of fourier transforms and simple correlations to make a basic forecast of how many VMs to have ready at different times of day. A reactive autoscaler adjusts on the day.
[1] https://medium.com/netflix-techblog/scryer-netflixs-predicti...
[2] https://medium.com/netflix-techblog/scryer-netflixs-predicti...