I don't think you have to worry... there is a NET outflow of people living in California[1]. Why? My mother always said if you don't have anything nice to say about a group of people, don't say anything at all.

[1]https://www.manhattan-institute.org/html/great-california-ex...

There's a net outflow when considering purely domestic migration, maybe. California's population is still growing, driven by immigration and births.