There's security, basically there's two vectors a Hetzner compromise can be used against us, either they reboot a machine and get our data through rescue mode, or they gain physical access. VPS'es can be hacked fully digitally and transparently (i.e. if you have access to the hypervisor you're in).

There's performance concerns as well, but those don't really apply for ARM as obviously you can do better.