You pretty much need a state ID or drivers license, which lists your skin color. Political contributions are a matter of public record for anticurruption purposes. Vital records offices are more than sufficient for tracing ancestry. Welfare offices know who is poor and medically needy. Telecoms and the post office knew who you communicated with.
There was more than enough information to mount a holocaust on any of those axes long before the current crop of tech companies.
Again, this worst case scenario may not happen, but the fact that it can, even if only with a small chance, makes this massive data collection totally irresponsible.
Also it's a bit of a bizarre argument that tech companies are doing data collection on such a massively intrusive scale, we should really look at the government databases first because they're already more than enough to screw us over with? It's not even a "but they're doing it more!" ...
On the other hand, the data private organisations collect is not restricted - neither what data is collected, nor how or from who.
If voter registration started to ask for skin color, there would be immediate public outrage. If credit scoring services include skin color as a scoring factor, it's a trade secret...