When people say richest country per capita, they dont mean "including native Americans and slaves". Those were not citizens. It is profit and wealth of whites that count.

You are however averaging production to slaves too. So in countries where blacks outnumber whites you get much smaller wealth then what contemporaries commented on.

The alternative scenario is north in any case. The kind of society and production south was is plain impossible without slavery. It just did not exist.