It's not necessarily true that you want to pay of your mortgage.

Mortgage's have tax benefits, and if you have a mortgage at the prime rate, then your money is likely more valuable invested elsewhere, while you pay the mortgage.

High interest credit cards are another story.