That's an interesting point. If the American Revolution hadn't occurred in 1776 (or had failed), the Southern states at least would likely have rebelled if the English had attempted to abolish slavery in the 1830s-40s.

Then you have to wonder whether the northern states would have sided with the South or with the English.