It would basically be your word against the credit card holder anyway since there is no physical proof so I can understand why they can't. Anyone could make up some proof. The root problem is with the banks: it's their system that is being used fraudulently and they should be the ones paying for it so that they have an incentive to improve it.
Anyone could make up some proof.
Well, yes. But people generally don't go through the trouble of making up proof for relatively small transactions (<$100, from the merchant's perspective). It's simply not worth the time and effort to fake up proof for something less than a $100 unless the work would take a minute or two more than simply collecting the evidence supporting the transaction.
For PayPal the user has to supply a chargeback reason. We had a user type in "I need money to pay my rent". That was the exact text. The customer has admitted fault, but paypal still decides against us.
Edit: We have a US company and paypal account so it isn't that.
Anyway, from my own recent experience and what I heard from several indie devs, even after providing server logs & screenshots, PayPal can't do anything (and I'm not blaming them, I'm sure they do fight the charge if at all possible)
EDIT: Oh, just saw you wrote "US seller". I'm not in the US so that might have something to do with it maybe.