That’s a truly meaty take on the Ship of Theseus[1] problem. In my mind, like so many philosophical problems, the fundamental distinguishing point is materialism vs dualism. For the materialist different matter means different ship. For the dualist the matter is just expressing an ideal. I’ve heard that in Asia there are temples that were totally destroyed and then rebuilt and everyone considers them as old as since their first building date.

[1] https://en.m.wikipedia.org/wiki/Ship_of_Theseus