I believe the inefficiency of an empty freezer/fridge actually comes from it being inefficient to cycle the compressor. The low heat capacity of air leads to the compressor cycling often.