As an American living in the US all my life, I've never seen anyone casually toting around guns on the street anywhere, except on TV.

EDIT: I'm not denying that you saw that guy with the glock, but your last sentence makes it sound like it's a common occurrence in the States, and it really isn't.