High volumes of chargebacks are an indication of fraud which is a larger issue than the fees. Especially if a processor uses a big bank to use the payment rails, the bank will monitor fraud levels of the processors and will exit a processors business altogether if it's too high, meaning the processor is out of business. That's why processors won't work with high chargeback risk businesses, keeps the average low.