You can't just look at the NASA budget. Defense spending was also a huge part of our activities in space.

My grandfather built satellites at Lockheed in Sunnyvale all through the 60s and 70s and it was a glorious time for him. For reasons that I never quite understood, he hated Reagan for "destroying the industry" in the 80s (by which time he was in Denver at MM).