I should've been less broad, I wasn't saying that the entire state has Spanish speakers, just that a very large community was there. There was a significant Spanish speaking population in California though, they are called californios and I believe they were a significant minority (probably 1/3 of the population) at least in 1850.
Also you're right,I was completely wrong about Florida.
This is a completely inaccurate and hamfisted statement. By the time of the Civil War, California was already predominantly Anglo. The only Spanish speaking parts at that point were the southern part of the state, which was sparsely populated compared to the Bay Area.
Florida was already filled with Anglo settlers as well. Spain had a number of horrifically protectionist policies that doomed their outlying North American colonies to poverty and depopulation, making them extremely vulnerable to infiltration by settlers from the US, who ironically, were illegal immigrants.