I agree the cannabis-plot guy could (maybe should) get out-voted, but I'm pretty skeptical it could happen by doing a ballot proposition.
That would come up against the same forces that fuel NIMBY-ism, i.e. the relative political clout of home owners and the power of the story that it's my back yard today, but it's gonna be YOUR back yard in the next shadow.
The answer, as mentioned, is go to a higher level of government where there are even more people to outvote Mr. “But Muh Views”.
In the case of CA there’s seven million people in the Bay Area and 33 million in the rest of the state that would benefit from continued growth there and don’t care at all about shaded backyards in Palo Alto. That sounds like a referendum waiting to happen to me.