True, and even if everyone were a moral saint the pox would been devastating. But this was not a garden eden, but a very brutal tribal world with frequent ethnic cleansing and enslavements. Hundred thousands of native auxiliaries marched with Cortez to get rid of their Aztec overlords.
Anyway, this won't be an issue for Mars.
And then there was ethnic cleansing of native population.