It quite often means something creepy. You shouldn't assume that actual aggression aren't happening just because you have the privilege of not experiencing them.