Pumped hydro is not, in fact, very dependent on location. You just need a hill. There are a lot of hills.

Even places without hills often have deep underground cavities, which also serve.