Not getting to pat yourself on the back much for helping is one thing. Being at fault is fundamentally different.

We punish people who do bad things. We don't punish people who have neither helped nor done anything bad. We might we wish they had done better, but wishing and enforcing are very distinct mechanisms.