I always just thought of it as, the uppermost bit is that power of two but negative. So for four bits from right to left, if they're set to one you add 1, 2, 4... -8.