It goes both ways. I remember a conversation I had with a very nice Uber driver, a Muslim woman. She made a point of picking up female riders with low ratings, because she believed male Uber drivers would downrate them if they thought the women unattractive, or if they rejected advances.