You can easily take that to ad absurdum levels and every activity you do is destroying the world. There's a balance, and stone stacking happens to balance the line between posturing one's virtue and respecting an ecosystem.