I don't think he literally meant don't use debt as a vehicle; that's not really how government finances work IIUC. The suggestion is tying a funding source to new spending instead of taking on an unfunded liability. Carrying a year of interest at current rates is irrelevant.