True. Another thing to consider is that regardless of the health effects, sun exposure ages your skin; sometimes dramatically so.
A compromise would be to use sunscreen on your face and neck (since they don't produce that much vitamin D anyway, if I'm remembering a study correctly), but leave the rest of your body uncovered. Perhaps add sunscreen to your hands too.
So outside genes there may be some sort of adaptation going on.