The big difference is that we eat more calories, less carbs, more fat and more sugar.
There's a big increase in the amount of fat consumed, but I suspect a large part of the difference is going to be lifestyle, too. Around the turn of the century people walked a lot more and did a lot more manual labour.
Regardless - total calories went up. Carbs stayed almost constant in absolute terms (a slight decrease) and decreased in relative terms. Fat increased in both absolute and relative terms. I guess carbs must be the culprit!
Interesting that whole milk dropped off so sharply in the 1970s and 80s - about the time that 'fat is bad' started up? From what I've read, low fat milk contributes to heart disease too - something about the level of fat-soluble vitamins?