I agree that they are inherent, but it's not just governments that take them away, it's other people in general.

You could live in a totally government-free society and somebody, somewhere will eventually come along and fuck your shit up. Then you are just fighting to keep your rights, which for many might be preferable than trusting a government to do it for you.

The question is are you more likely to retain those rights under a government than without one? If so, what kind of government?