>I thought most of the time sexual harassment happened because the aggressor basically wants the victim to sexually submit (i.e. have sex).

Sexual harassment is harassment - behaviour intended to intimidate, disturb, offend, threaten someone - that uses sexuality as a vector. It's extraordinarily naive to assume sexual harassment isn't taking place if the aggressor's goal is not to elicit submission to sex itself.