An important slave-holding state for the North was Maryland. They did not secede or get kicked out or even made to become slave-free until they changed their state constitution after the Emancipation.