You cannot backdoor a device in such a way that only 'certain' people can access it. Once that door is there, people will find an exploit it. The only way to be completely secure is never build the door in the first place.