There are specific zoning allowances and health codes for "home bakeries" and that sort of thing (at least in my area).