Water is quite literally the only issue, and it's a very recent one. It's also an easy one to solve: follow Israel's lead and build desalinization plants up the wazoo. That, or pray that we mountain folks keep getting decent winters to sustain the summers. Pushing ranching (which is disproportionately-water-intensive) out-of-state is another option, as is figuring out ways to reduce ranching's water impact.
As for the low proportion of California's economy to which agriculture contributes, it's worth remembering that agriculture doesn't exactly have high margins. California's farms in particular are also heavily staffed with undocumented labor (which I reckon will skew a lot of data in all sorts of crazy directions).
Put simply: crops ain't the problem, and scapegoating the "dumb and dirty" farmers was already a tired trope five years ago, let alone now.
I thought a key American ideal is freedom. Why would you want to restrict people’s freedom and only give the privilege only to the few who just happen to be born early enough to get property there? (Even some California native sons and daughters cannot afford to buy a home in their own home city.)
By the way, flippant answers are not appreciated. Consider reading more about the topics before giving thoughtful answers?
California’s is a knowledge-based economy—Agriculture contributes but a small percentage to it (about 2%). Why should we restrict the number of productive people who can live in the state in favor of crops?
https://en.m.wikipedia.org/wiki/Economy_of_California