Terroir is the term for this. It's variation in flavour isn't as great as varietal/strain based differences. But yes it does have some impact most commonly taken advantage of in wine production.