Even if they weren't, unsafe properties affect the property values of those around it.

And of course... So many other things... Your shoddily constructed deck can blow into my house during a windstorm, for example.