You're right, I'm wrong, it's a debt that counts against you, but also an asset that counts for you, cancelling each other out (assuming market value of the home == mortgage amount)