One is that the states are often bordered by major rivers or oceans, the economic centers are there, and they want the capital to be somewhere closer to the middle of the state, geographically. Another reason is that it's more secure, militarily.