(To be clear, I'm not saying that there weren't existing cultures there before the US expanded out further west, but I imagine most people would agree that the US today isn't culturally as influenced by them as much as from the the colonies and pre-expansion US.)
I grew up in New England and have lived in the South and in California, and IMHO morality is a bigger determinant of the behavior of the average person in New England than it is in the other places I've lived (all in the US). The South and California are more pragmatic, less moralistic.
I don't have any experience living outside of the northeast (although not New England specifically since high school), but I definitely agree that there's certainly more religion in New England than might be obvious from the outside (more Catholic than the rest of the country, which also might explain some of the differences).