And now we are back where we started, with why is it selfish for me to claim it, but not you? Without property rights, no one has any right to anything and the world would be anarchy.

There is nothing selfish about property rights. If you make something, and want to use it, that's not selfish. If someone else comes and demands you give it to them instead, that is selfish.