You're right about the pueblos specifically. They're still extant mostly because the climate is so dry there.

Something like granite would be a much more long-lived structural material in wetter climates. Indeed that's the primary stone used in, say, Machu Picchu.