You do get situations where rivers cut through mountain ranges - it can happen when the river existed before the mountain range and as the mountains were pushed up the river continued to cut it's way through:

https://en.wikipedia.org/wiki/Antecedent_drainage_stream

[NB I sure Tolkien would have approved of the idea of rivers being older than the mountains they cut through].