When you live a place, you can and should have a right to attempt to change it. This is a basic tenet of American government (taxation, representation, etc.). Just because a place has "always" been a given way does not and should not mean it can never be different.
That, I suppose, is a long way of saying that zoning can change. And sometimes other regulations change in ways that are inconvenient for some, especially when those people have failed to make a compelling case for why things should not change. We call this "democracy".
Oh, it certainly can change. When the rightful owner of a property decides that it's time.
You have no legitimate right to demand that anyone do anything with their property based on your preference.
Only to the extent that details like democracy, zoning, and free speech permit.
Which is to say you can demand all you like, but until enough people agree with you the right way it doesn't matter.
It's intellectually dishonest to cling to the principles of democracy on the municipal level but then complain about them at the state level.
"Right to farm" rules are an example of democracy in action.
So there are restrictions on pretty much any use of property in a given town or state. The ability to build a house, run a farm, or build an asphalt plant is allowed or not allowed by the zoning. It's not about having a special "right to farm" any more or less than it's about having a special "right to build a house."
EDIT: Just add that the "right to farm" bylaws are mostly a reminder, especially to newcomers, that people have, um, a right to farm based on existing zoning. So don't move into our country town and then start a petition to close down the dairy farm down the street because it gets a bit smelly now and then during the summer.