There is no reason (that I’m aware of) to think that prior to recorded history we were somehow more restrained with groups/individuals who were weaker than us or outsiders.

But hey, I suppose you never know.

Edited to be sure not to distract from the actual thrust of the argument :)