It is dangerous to view it literally this way. To think that government and/or society is giving you things, assumes that they owned them to begin with. Government owns your rights, and then "graciously" allow you to exercise them? No.
Government exists to protect your rights. It's an important distinction. You rights to life, liberty, property, etc. are innate to you as a human being (the fact that others in the past have not had this view does not disprove this philosophy), and we created government and the notion of a rule of law to protect those rights.
Of course not all systems of government work this way, we call those that view themselves as the arbitrary "giver of all things" tyrannies.
Obviously, we need to take into account that now, unlike 10,000 years ago, people no longer have the option of leaving society completely, so they have little choice in the matter, and in order to restore some of that freedom, private property needs to be protected by law. But again, property is not a natural right; it's a social convention. That should be the premise.
Elected officials are representatives of the populace. "Government" is, then, is not some alien entity, but at least in principle, the voice of the people. The government is therefore not the taker of all things, but the giver of all things, and let me explain that:
The right to private property isn't a natural law, or even the natural form of human behavior. Human beings started out living in collective tribes. It's not that property was shared, but that there wasn't much property at all. Sure, I guess some men objected forcefully to others taking their women, but the transition from women to material property is certainly not an obvious one.
Only with the advent of agriculture humans started having anything resembling property at all, and it was their decision to allow property to be owned "privately". It was society, or "government" if you will, that created the notion of private property through a social contract in the first place.
So it is society, or government, that graciously allowed you to "own" anything, but that by no means implied that society could not place restriction on ownership. And if you didn't like the rules you were welcome to leave and spend your life away from society.
Sure, this arrangement is pretty much the only one that has worked so far, but there have been many revisions and will be many more. But the premise should not be that society infringes on private property, but that the meaning of private property is constantly re-created and negotiated by society.