Any human activity had an impact on the earth. At some point even the most well-intentioned of us have to accept that some big benefits may come at some (ideally lesser) costs.

I would ask those locals if they are ok with having no electricity other than what they can generate themselves on their own houses.

Desert may be a fragile area, but what is the real impact of its disruption? Everywhere there are tradeoffs.