It's not minor, it's borderline assault. Whether you're offended or not, you don't get the right to go around assaulting people like that.

Now, don't get me wrong, the guy was a dick, and it sounds like it was sexual harassment. And it should be dealt with swiftly by HR, but that should be the end of it.