There are some good things about safeties -- service pistols had them for decades. There didn't used to be nylon holsters, after all.

Another thing that people do is set up a holster behind the headboard or somewhere else where they know to get at it.