You should anyway, as it's still a waste of energy, but if you are just curious about usage you can get smart plugs that will tell you how much energy a plug is drawing. That would let you see energy usage, and by extension, the energy bill.