You need to remember that the horses were warhorses, and were taught to "fight" as well - they would bite, rear up and hit with their hooves etc.

So they would be vulnerable, but the horse itself has a vote.