Backup software that allows for write-once-never-modify is great in that regard. One of my favorite features of tarsnap: you can separate privileges for writing backups and removing. Introduces a bit of overhead, though.