You asked why it makes a significant difference. And it looks like you answered your own question. A calorie being a calorie is one of the less interesting factors when it comes to actual practice. And yet it gets repeated ad nauseum every time the discussion comes up.