The problem with looking it this way is you are ignoring another thing the brain does, which is to link events in memory with emotions, and triggering these emotional responses in turn release all kinds of chemicals that affect the way the brain functions.

Granted this link fades over time (and likely therapy helps), but the body is not always good at handling major stresses and the damage can become permanent.