I guess it's maybe because we've had different experiences. For example, I could see me saying "Hey ladies" to the group of girls that I went to school with. I couldn't imagine addressing women on the street or in work with that phrase unless I developed at the very minimum a friendly relationship with all of them.

But that's just me, you are totally correct I've seen lots of people do it without any complaints what so ever.