You can leave the horse behind and continue by walk if you think it gives you advantage. The speed and maneuverability here is not just about during combat, but mostly about ability to do long term plan and maneuver.