Horses aren't banned. If you spend some time in a big city, they're everywhere. Police ride them, people ride them, people use them to pull carts and pull other people. The horses are always less useful than machines, but they exist.