After a while assimilation and integration occurs and thus the argument would not apply to present day California. The U.S. made no attempts to incorporate Panama, as a whole, into the U.S. Poor Panamanians were prevented from getting mangoes in the Canal Zone. It took rioting and deaths before the Panamanian flag was flown in the Canal Zone. I don’t think the comparison to California is apt.