I am not sure to follow, why couldn't the vast majority of uses of this base model be nefarious/selfish?

Isn't it like saying "let's give infinite power to all humans on the planet, nothing can go wrong since they define what is humanity" ?