Much of the "wealth" was the people they enslaved, so they did not get to keep it. The American Civil War is seen as a huge and enduring economic loss (but moral gain) for the southern states.