Nobody denies that Musk family was wealth. They were wealthy because his father was a successful engineer.

And at one point his father made a small investment in a mine. And even that is grounded on shaky evidence.

This mine investment might have been profitable (we dont know) but the idea that his family had some waste emrald mines is nonsense and that investment certainly didnt make the family rich.

And given their bad relationship, Elon lost support from his father when he came to US/Canada.

So your source is businessinsider? Elon himself says the story is bogus and when he came to the US, he came with nothing and ended up with 100k in student loan debt. And from where he lived and what he did, Elon was certainly not living some "rich man" lifestyle before the Zip2 and PayPal days, and no one who knew him in those days has shown any proof that Elon arrived in the US with any sort of wealth.

Rich man from rich family denies that his family riches contributed to his success, more at 11.

Zambia didn't have apartheid.