Inflation has more to do with the amount of money in circulation. If you finance with taxes and not debt, the value would stay constant.

But a bit of inflation may not be the worst thing – the current almost-deflation is a lot worse and both private and public debts could finally be lowered. Unfortunately, it's a pretty imprecise mechanisms and there are some people that suffer disproportionally such as those around retirement age getting fixed pensions.