The problem is private debt, particular private debt that doesn't self-liquidate (consumption). See Steve Keen (certainly no puritan on debt) on the distinction between public debt and private debt and its effects on the economy.
How much of the budget can truly be scored as investments? Perhaps not even the bulk of student higher education loans....
Keen is very good on this and has convinced me, despite it going against my inherent anti-debt biases.
Of course the Federal Government isn't a "giant household", it's worse in many respects, with the decision makers generally not thinking past the next election, whereas there's a chance in a household the elders will be thinking of the children's futures (things like Social Security, and the general Zeitgeist that the government won't do stupid things like repudiate the debt, have of course helped to sunder the bonds between generations, something I think a lot of "elders" will heartily regret in due course).
It has a debt-to-income ratio of 14.3, the highest possible credit rating, and assets that far exceed debt. Lenders would be tripping over themselves to lend to to such a household, and lo and behold lenders are tripping over themselves to lend to the USG.
This dour anti-debt Puritanism is dumb enough when it comes to individuals, but makes no sense at all when it comes to government.