I completely agree, we can't dismiss survivorship bias.
But let's imagine we are in a speculative historical sci-fi novel.
An ancient civilization makes contact with an alien one and they gain access to a new powerful way of building that had no precedent in history.
Fast forward 50 years, aliens are gone for good, there's no easy way for the layman people to access documentation let alone understand it, people will obviously don't understand what's going on, but they would see older buildings collapse after a mild earthquake or be destroyed by a wild fire, while some of them would survive, mutliple times.
They would most probably think of them as safer structures and give them more value and try to preserve them because of their "magical" ability to survive catastrophic events.
They would probably think of those buildings as gods gifts or sth like that.
Imagine that instead of 50 years it went on for almost a millennium.
And then the knowledge on how they were built got lost.