Of course the reason given isn't "I got caught by my wife", it's "I don't know how that charge got there, it must be ... fraud".

Payment processors are required to maintain a certain chargeback rate with the card companies and so that risk gets passed on to the merchants.

This is all exceedingly well documented and a Google search away if you'd like to learn the inner workings of it.