It's a little more complicated than that. To take an extreme example, in some cases you can use force (even deadly in some states under certain circumstances) to exclude trespassers from 'your' property. Thus, the right to property is not only a right to have the gov't protect it for you, but also a restriction on the government from prosecuting you for certain acts taken by you on your property.