You probably also want to do somewhat intelligent load shedding, where you basically make sure you drop the most expendable items first.

That's a basic fact of life for CPU cycles even for consumers on their machines, we call that just CPU priorities or so. But it's also useful for the other resources; but there it's a bit more disruptive, because we generally need to disrupt a program to eg claim back the disk space it uses.