Wouldn't the argument be the other way around, that capitalism is inherently corrupt?

Same as any other system which allows largely unchecked power.