The thing is that "inflating it away" isn't a serious long-term proposal. Suppose we were do something drastic, like target 6% intentional inflation, obviously nobody would buy bonds at 6% anymore, they'd demand at minimum 12% (because they'd lose 6% of it due to inflation). The spiral runs away, there's no secret cheat to a free lunch.