You don't need to put your private key on a mobile device. You can create a separate key for each device. Pass supports multiple keys.