Slavery was a boat anchor on America, not a source of strength. Most of the dynamism and power that was built in the US took off not coincidentally after the wane of slavery.

And until very recently the former slave owning states were and in some ways remain sleepy backwaters dependent on the largess of the military and welfare to remain viable.