For example, if government has few regulations on starting a business, there little need for corruption. If, however, there are a lot of regulations, then the result will be that you need to "payoff" local officials in order to open and operate a business.
The question then becomes: why do eastern peoples tend to tolerate big, intrusive governments and western people tend to like freedom?
Say what you want about Christianity itself — I'm not arguing for or against it — but I believe that it's because those are the societies in which a Christian morality was prevalent.
A key aspect of Christian morality is fairness: do unto others..., pay people what you owe them, don't accept (or give) bribes.
Corruption opposes those values and can't thrive in a society that embraces them. If those values don't exist then corruption has a chance.