I do NOT agree that I an responsible for my neighbors or their land and this is part of the issue. If my farm dumps a bunch of crap or ejects a ton of pollutants into the air, this harms my neighbor and should be limited. If instead, I build my farm and is net 0 pollutants to your land, why exactly should you be able to do on 'my' land, or put another way, who is the victim?
To frame this another way that I think is fairly similar to nuclear, I think large scale organic farming is extremely taxing to the land in the long run and is a fairly terrible agricultural practice at our current scale. Does this mean we should enact laws and regulations to stop organic farming? I'm really not so sure, I can understand both sides and I don't think this type of legislation will ever be so cut and dry.