It's mostly about the introduction of diseases like Smallpox and Malaria that did almost all of the killing. Lots of places like the American South and the Amazon basin lost huge populations without any European having to show up in person.