Even if you have a trezor (or other hardware wallet), you back up your private keys (all those words) somewhere else. That is the real security hole in all of this, not the risk of losing your device.