You'd think so, but here's a video of for example a hippo vs a rhino without (much of) a horn: https://www.youtube.com/watch?v=XW-GX7o7hBc

Also when a pride of lions get hungry enough they'll go after anything, at which point having a horn makes all the difference.