Probably to a small extent but the more pronounced effect is the heat gradient. The rest of the house becoming quite a bit colder just sends you back to the fireplace, which is generally not a bad place to be, so overall it's not a major issue.