According to a post I read a while back on the Cybercrime Blog, you cannot prevent authorities from opening the safe or refuse to hand over a physical key (with a lawful warrant, at least), but you are under no obligation to provide a combination. I'm pretty sure the combination thing was SCOTUS precedent, but I'm not 100% certain.