Fat stores are considered, metabolically, as stored energy as they expand and diminish based on the metabolizable energy of the diet, which may be different from the measured total energy.

But you’re definitely right! There’s a great Mr. Wizard-style TEDx video about it: https://youtu.be/vuIlsN32WaE