The title is one way to recognize the rightful owner. If the title is destroyed or missing, those who believe in natural rights would still recognize ownership. Those who believe in state-given rights might not.

Also, you mentioned earlier that mere possession does not imply rightful ownership. I totally agree, as would anyone who has been the victim of theft.