The Atlantic had a photo essay about a riding club in North Philadelphia a couple years back. I don't know if they race, but it's still pretty crazy to see people riding horses in Philadelphia:

https://www.theatlantic.com/photo/2017/02/fletcher-street-ri...

Here's the club's site:

http://www.fletcherstreeturbanridingclub.com/main.html