You're not usually meant to use force to prevent trespass outside of some very narrow circumstances. And whether someone is trespassing or is somewhere they have every right to be is very often unclear.