A lot of towns actually have right to farm bylaws. There are some restrictions--I think it's a 5 acre minimum acreage in my town. So I agree with your general point but agriculture is considered normal use of property in many places.