Right, but you DO need to file the tax returns with the IRS, accurately reporting your income, and then actually negotiate the payment plan (and stick to it or renegotiate).

We don't just get to unilaterally declare that 'I'll be uncomfortable paying taxes, so it can wait'... and then not bother to file or negotiate a plan, which seems to sum up OP's position. Wish him/her luck, they'll need it!