Yea visual stimulation is _at least_ as distracting as audial for me as well.

I'm not sure I get the fight or flight response, but I certainly am constantly aware of the people walking by constantly.