It's not necessarily race. How about a bad rating for getting a ride to an undesirable part of town? Or one where the driver can't find another rider?

At least in 2014, it sounds like Uber has no way to verify racism isn't happening: http://www.theguardian.com/technology/2014/jul/28/are-ubers-...