Where is this notion of "you can do anything on your property" coming from? A similar one is also "it's my car, I'll do what I want with it", etc. But all modification to both your house anr your car have a big possibility of puttinf others in danger. If you mod your car in a dangerous way or screw up your house electrical wiring, other unrelated people may get hurt - you don't have the right to do that!

Physics allows it? This in the same way one can commit crimes or at least that's how I read it. Clearly one can not do the things physics doesn't allow.

As you point out there are likely punitive consequences but those are after the fact.