I agree with this premise. Backup to another provider, and also make sure it is in a different physical location - different city. In the old days you would pay a company to take a tape backup offsite so why not keep to that idea.

Of course you should be applying that logic if you rent rack space in a data center - your backups should definitely be outside of that data center somewhere else.