I'd expect any decent infrastructure tool to be able to handle 4000 processes/containers. Kubernetes, for example, claims to support 300000 containers across 5000 nodes. Mesos supported 50k+ from what I understand. Hadoop scales to over 10000 nodes.