You are assuming that people only do chargeback in the case of some kind of fraud where other people stole your card details and spent your money. That is not the case. There are many other reasons to do a chargeback, far more reasons in fact.