The title is one way to recognize the rightful owner. If the title is destroyed or missing, those who believe in natural rights would still recognize ownership. Those who believe in state-given rights might not.
Also, you mentioned earlier that mere possession does not imply rightful ownership. I totally agree, as would anyone who has been the victim of theft.
Actually, you made my point for me. The point is society limits the way people can use property for practical reasons. There's no reason you can't do that on intellectual property because "omg it's made of bits".