That release of energy does result in mass loss. e=mc^2 as everybody knows, without understanding. However the energy is fairly small, and c is already extremely large before you square it. Over an entire lifetime the mass loss is still insignificant.