Having been to and through those regions I agree, I would not want to vacation or visit there without good reason. However, the show(s) made it seem like a fairly quiet and comfortable region (barring the cartels and drug addictions). Other than certain desert scenes, they really didn't do the environment justice; I rarely felt like long-sleeved Oxford shirt-wearing Walter or suit-wearing Jimmy/Saul were sweating constantly, which contradicted my own experiences, and I've been there in all months of the year. It does get chilly, as any desert/scrub land region does, but it felt a little off. I have the same issue with all the Dune adaptations, they just never really get across the temperature and/or humidity of the place unless it's relevant to a plot point.