So kick out the freerider! Avoiding doing anything about a problem just because there's potential that some asshole is going to come around is not a good reason to avoid helping others. Some asshole is going to come around and disturb you anyway, might as well help out other people while you're at it.