Europe didn't have that many native peoples to displace. Colonialism rather dented the record for the countries that got into it though. And many that didn't got conquered. So kind of a survivor bias.