Because there is nothing backing it. Normal bank loans are not inflationary because collateral must be supplied to back it up. No collateral, no loan.

For example, if you take out a mortgage, your house is collateral.

The government just issues more debt to pay off the old debt.