Re:Introducing Preemptible VMs
by CoolGuySteve on Monday May 18, 2015 @11:21AM
(#9564942)
We need maybe 1GB for each job, but we need some leeway to avoid the OOM killer when a group of work units is larger. Swapping takes so long that it's not cost effective.
But to be honest about the situation, the cost would have to be much lower to make it worthwhile for me to rewrite our scheduler on Google's API.
Note: we're very aware of this pain point, and maybe you'll see something soon ;).