That is true; however, we cannot remove a tangible thing without it being obvious that it's lacking and unavailable to the owner. As a result, more people are on board with the tangible property social construct.

Intellectual property is more like, you and I have some tangible property, and I'm not allowed to tweak my property into the a particular configuration that is exhibited by your property (or equivalent forms), without permission.

That situation also defines privacy, and also secrecy.

I suspect more people are on board with caring about privacy and secrecy, than caring about copyright.