Re:We use Kubernetes and spot instances to reduce EC2 billin...
by halbritt on Monday February 24, 2020 @11:11PM
(#22410843)
GCP has a similar instance type called "preemptible", they're not quite as cheap as spot, but they don't "dry up" and they're guaranteed to go down every 24 hours.
This precludes one from becoming complacent with spot instances that rarely go away.
Re:We use Kubernetes and spot instances to reduce EC2 billin...
by jedifans on Tuesday February 25, 2020 @01:00AM
(#22411234)
https://cloud.google.com/kubernetes-engine/docs/how-to/preem... states that preemtible VMs aren't guaranteed to be available.
Re:We use Kubernetes and spot instances to reduce EC2 billin...
by tuananh on Monday February 24, 2020 @11:54PM
(#22411006)
You're right. spot instances are a lot more stable than preemptible. we've seen spot instances that last a year for us.
Re:We use Kubernetes and spot instances to reduce EC2 billin...
by halbritt on Tuesday February 25, 2020 @12:02AM
(#22411035)
This is the second response of this sort that I'm replying to.
"A lot more stable" isn't really a desirable characteristic of ephemeral compute capacity. In my experience, the less frequently the instances went away, the more complacent the operators became.
Preemptible instance are stable in the sense that you know they're going away within 24 hours and must be prepared for that.
Re:We use Kubernetes and spot instances to reduce EC2 billin...
by tuananh on Tuesday February 25, 2020 @12:05AM
(#22411044)
true that.
spot used to be that way and the price was very sensitive. but AWS tweaked it so that it's more stable.
to the point, after a year or 2 of running spot instances, we don't feel the difference of spot and ondemand that much. we got complacent.
Re:We use Kubernetes and spot instances to reduce EC2 billin...
by raverbashing on Tuesday February 25, 2020 @04:23AM
(#22411854)
Yeah but Kubernetes "self-healing" a lot of times isn't. Or it just trips over itself (stuck pods, stuck cronjobs, etc).
The indirect effect of building on a system like this is that the recovery mechanisms get tested on a regular basis instead of just on the odd day when things fail.
Spot instances are like a natural chaosmonkey mode, with money being saved and forcing you to build failure tolerance, retries & circuit breakers early in dev.