The Vitamin D hypothesis is just that, a hypothesis, and probably not true. In the summer you produce enough after 10-15 minutes, and in the winter you produce none at all above a certain latitude. Furthermore, if it were a simple "loss of melanin" mutation, you would expect something similar to the favism mutation (G6PD deficiency) which protects against malaria - there are lots of ways to have a loss of function mutation, and you see a bunch with G6PD deficiency. Compare to SLC24A5 gene mutation, which reduces melanin production and accounts for a substantial fraction of paleness, and exists in 1 form that is fixed in most European populations. So paleness was probably selected for some other reason. FWIW there is also basically 1 blue eye mutation and 1 main blonde hair mutation.
> which allowed more ultraviolet damage thus increased mutations (blue eyes, red hair and so on).
I think you basically have this backwards. At the equator, in the evolutionary environment, you need dark skin to survive. Otherwise the sun will cook you. So there is very strong selection pressure to maintain that. Further from the equator, that selection pressure is relaxed. But it is not UV rays causing the mutations - rather, these random mutations happen (for whatever reason) and are not immediately culled by UV radiation, so if they provide some other advantage, it's possible they will win out.
Note: Everything I posted is also conjecture, I don't think anyone really knows why paleness mutations exist :)
So if 4% is the difference between humans and chimps then 2-6% can be very significant, right? Or can those numbers even be compared?
For example if Humans and Bananas each have 5000 coding genes in common the difference will be measured only on those genes we actually share (out of 20-25K coding genes in humans, no clue how many coding genes do bananas have), so the difference is actually much greater than the 50%, 4%, 1% or what ever figure you get because the big differences are simply discarded.
These days there's a cartoon for everything :) https://www.youtube.com/watch?v=IbY122CSC5w
And this is without even going into gene expression and epigentics which play a role which some might even consider to be bigger than what actual genetic data you might happen to carry along with you.
Heck chickens still have the genes to grow teeth and feathered scales like the dinosaurs they've evolved from however these genes are not expressed anymore in nature.
Another interpretation is, moving to Northern climates with reduced sunlight resulted in decreased melanin (to ensure sufficient vitamin D) which allowed more ultraviolet damage thus increased mutations (blue eyes, red hair and so on). In this view, Africa retains 'modern human anatomy'; the rest of the world is a sort of Galapagos Bird situation.