You have control over who can see your location in Find My. If a stalker has access, that means they're already someone you trust or you've never looked at the list of people you're sharing your location with.