Ignoring the structure of actually related areas of law, as ditching intellectual property as a category would be doing, is great if you want to deceive people, but very bad if your intent is to educate and help people understand the law.
IP is a subcategory of intangible personal property, which is a subcategory of personal property, which is a subcategory of property. There are legal principles that are generally applicable to property, others that apply to personal (as opposed to real) property, others that apply to intangible (as opposed to tangible) personal property, etc.
IP isn't particularly closely related to "physical property" (which isn't a particularly useful category); nor does the term suggest that it is. Real property is in a separate branch from IP at the highest level of categorization of property rights, and tangible personal property is at the next level down. It is more closely related to things like debts and choses in action (rights to sue), which are, while not IP, also intangible personal property.
And there's no need to make it an us-vs-them issue. Nobody is defining terms to fit their agenda, criticism of IP is simply pointing to differences that are already codified in law. So if you don't like it, take it up with your legislators. You don't have to be either for or against copyleft to want say the big scary copy-r-word to your developers. Even the most ardent copyleft haters and copyright abolitionism idealists are shooting themselves in the foot when they make snide remarks toward lawyers about their "legalese", before they know it reality will catch up with them and they'll be hit with overly broad patent suits or some jerk will infringe on their trademarks.