Hannibal did terrify Rome with them for a while, but Scipio Africanus figured out a very simple strategy to defeat them, which won the second Punic war for Rome at the battle of Zama. He just made corridors in his formation and channeled the elephants down them, which then ran away scared from the battle all together.