You can do that, but not even the EFF is saying that the uncertainty of your machine being compromised by a targeted attacker should prevent LEOs from being able to obtain a search warrant for it.

Give a close read to their recommendations, and then map them back to the scenario you propose.