Ideas are just inherently unlike physical property on a very fundamental level. If my neighbor lends me his hammer, I can give it back. If my neighbor lends me an idea, it never left him, but I still can't ever rid myself of it.
No matter how much I care about content creators being compensated fairly — and I do, both for philosophical and selfish reasons — it is a farce to pretend an idea that exists in everyone's heads and originated in none of them is the exclusive property of one person. It is simply unnatural in a way that physical property isn't.
I created Harry Potter, not J.K. Rowlings? My labor in reading the novels is equal to her labor in writing them?
I think that argument falls flat particularly with copyright because there is no copyright liability in the face of independent creation. Copyright doesn't prevent anyone from owning their original ideas, even if other people independently think of the same idea.
> Ownership of physical property is natural because physical property is inherently rivalrous and excludable
While that's one philosophical justification for property, we've had property long before anyone coined the phrases "rivalrous" or "excludable" and it has been justified for reasons that have nothing to do with those economic concepts: http://en.wikipedia.org/wiki/Labor_theory_of_property. Going back further, see Psalm 128:2 ("For thou shalt eat the labour of thine hands: happy shalt thou be, and it shall be well with thee.")