I just have Ctrl-a set as the primary, and on remote boxes (where I run a tmux which ends up running inside a pane in my local tmux) I use Ctrl-b. Took about 20 minutes to get the muscle memory to adjust for it and now 15 years later I'm still very happy with it.