The fact that the skin of your ancestors rapidly evolved to become much lighter as they migrated to more polar latitudes tells you all you need to know about whether diet was an adequate source of vitamin D.
Light-skinned people are particularly well-suited to obtaining all the vitamin D they need from sunlight alone.
It is dark-skinned people currently living far from the equator who benefit the most from vitamin D supplementation, because the melanin in their skin reduces their ability to synthesize vitamin D from the meager amount of sunlight they get.
The people who lived in Western Europe for likely longer that it took for white skin to evolve in the middle east/caucasus(?) region were much darker skinned.
Also given how long anatomically modern humans have existed several thousands years is not such a short period.
Cold water fish has the highest amount of vitamin D.