The South lagged considerably behind the rest of the union in education, and for that matter prosperity,before the Civil War: see de Tocqueville writing in the 1830s or Olmsted in the 1850s. Slavery did have something to do with the latter anyway.