You're taxed on the balance as income. It's easier to negotiate with the IRS, though.
There are regulations that say the public service forgiveness (10 year) is not taxable income. The ordinary forgiveness (20 year) is taxable under current law, but IBR/PAYE hasn't been around long enough for anyone to have triggered it yet. There are proposals to exempt it.
The current interest rate for new undergraduate debt is 4.29%.