I am sure hunter gatherer societies were also very territorial. If the area you are hunting or gathering does doesn’t have much animals or plants, all the hard work won’t get you nearly as much food as someone who has a lot of plants and animals on their land.
And if you don’t think early humans were territorial just take a look at chimpanzees or even lions. Being tribal and territorial goes back a long ways.
1500 years ago those who could hoard land and power and influence after the fall of the Western Roman Empire went into decline formed the kernel the feudal aristocracy. But those who were able to capitalize on the merchant and industrial revolutions starting 500 years ago, and the rise of global capitalism, became the kernel of the bourgeoisie in the modern era.
We'll see what happens next.