The big problem with these temples is not religion it’s deforestation. The spine is made of old growth timber. So some of these temples survived over a thousand years until the central pillars were deemed unsound and needed to be replaced. Problem is that the new pillars are estimated to need replacement again in 400 years. They are made of less sturdy stuff.
Also AFAIK most of these constructions are made of wood, which also mean they need to be rebuilt over time. I think I also remember it is even part of the Buddhist tradition (at least for temples), a way to emphasis the impermanence of things.
See for instance this long but fascinating video on one of the most famous temple of Kyoto: [1] https://www.youtube.com/watch?v=rAeN7TdGq4o
Found another reference, but for a shrine: [2] https://www.smithsonianmag.com/smart-news/this-japanese-shri...
We shouldn't assume that all of the world's faiths follow the tradition of building temples as permanent monuments of stone and gold.