As someone who spent his summers getting fresh milk (often still warm) from a nearby farm, and pasteurized milk the rest of the year, I can't say I ever tasted much of a difference.