No, you don't. you can fly over high mountains, having a lot less distance between the plane and the terrain, but how you lose altitude is more important: just a single km drop can be unrecoverable if exceeding VNE and losing a wing in the process.