Those vacationers are going to permanently move to your "paradise" when they want to retire or start families and it will be a paradise no longer.
We are an old state with a dropping population, hence why the government is trying to attract new residents. Seriously, grab your skis, get in the car and come on up; the more the merrier.
Vermont was reliably Republican until there was the perception that the GOP had an evangelical social agenda. Vermonters are not against private expressions of faith, but they believe it is deeply personal and have no interest in being lectured on it by politicians.
There's a lot of people from NYC that want to retire upstate but come to the realization that NYC has done a very thorough job turning the entire state into a dump and that the only way out is to move out of state.
However, as a sibling comment pointed out, even if you ignore transplants the people of Vermont tend to agree with the modern left on a certain set of social issues anyway.