You can always keep yourself warm by adding layers, but it's hard to look professional beyond a certain point. It helps somewhat if the clothing matches the weather, but I find it's often colder in offices during summer due to AC.