Re:You probably don’t need AWS and are better off without it
by oneplane on Wednesday April 20, 2022 @11:33PM
(#31105793)
We have that 'issue' with many of our Spark workloads where there isn't any of our desired capacity available as spot, but we have a baseline reserved up front instances for anything realtime anyway so with a bit of planning it's a non-issue.
It does cost money, but then again, so does not running certain processes. The trick becomes calculating the intersection at which point the costs outweigh the benefits, and that calculation applies everywhere.
All AWS had to say was “we are working hard on providing additional capacity”.
The same often happens on black friday, where companies scale up their platforms just in case because there might be no capacity on AWS.