There's the "how much of my company exists in a black box controlled by some asshole" angle as well, but in my mind the biggest issue is that current models are already capable of saturating a dev in like four hours.