I agree with you. Water facilitates heat transfer, and the surface of skin is about 95f, so it seems that below that temperature, and assuming you aren't already sweating for the evaporative cooling effect, humid air should move heat out of your body more effectively than dry air.