It's hilariously out of the way, but it seems that the Northeast Kingdom region of Vermont is cranking out some seriously good food and spirits. Caledonia Spirits makes two extremely solid gins, and the aperitif ciders from Eden Ciders have to be tasted to be believed.
Willey's Store in Greensboro will have most of Jasper Hill cheeses for sale and maybe an experimental cheese or two. The HQ for Ben & Jerry's ice cream is in Waterbury and the tour is fun (with a free sample at the end).
Depending on when you go there will likely be farmer's markets all through the area with local producers selling all sorts of great stuff.
I haven't yet been to or tried Farnum Hill Ciders in the Lebanon, NH area, but I've heard it's worth a visit. They've been in business at least 20 years, so they must be doing something right.
Hogwash Farm has pretty solid sausage (and other meats) and sells from a farm stand. I'm sure there are many other excellent similar farms. That's just one I've tried.
Woodbelly Pizza is a mobile operation based in Montpelier does wood fired pizza that's highly worth catching. The oven is on a trailer. They might be at the Montpelier farmers' market.
Cabot used to do tour of their creamery but apparently discontinued that in 2018. They still offer samples, according to their website. Their location in Quechee also offers samples.
If you come during sugaring season, you can't throw a stone without hitting a sugar house. I haven't yet had bad maple syrup.
Less Vermont-specific, the Inn at the Long Trail is home to an Irish pub with a pretty broad selection of Irish whiskey.
And getting pretty far afield, the Euro Delli du Village in Mansonville, Quebec had some pretty damn good sandwiches when we were portaging through in 2016 or 2017. If you've made it as far as Newport VT, it's only a half hour drive (plus a border crossing, obviously).
I'll have to check those out, thanks for the recommendations! Especially the gin and cider sounds great!
American cheeses are different, though, sometimes because of pasteurization laws. If one wants a great Brie then don't get an American cheese. But if someone wants a great bloomy-rind cheese that can rival the best European cheeses try Jasper Hill's Harbison (or any of the others mentioned above).