There will always be consequences. If you attack your neighbour there is a chance that it will go badly for you. There is also a chance that a group of neighbours will join forces to remove you as a threat. That’s the kind of dynamics that has created the modern society: groups of people joining forces to overpower individuals that refuse to leave their neighbours alone.