> you now have to worry about your hypervisor’s attack surface and your actual OS’ attack surface

But the same is true of iLO. Worse in that case, because the iLO won't receive security updates for as long and is less well scrutinized in general than common Linux distributions.