I know someone that caught a charge for brandishing in similar circumstances and unfortunately it stuck, so I truly am sympathetic.

That said, I think there's a difference between being suspicious and keeping your head on a swivel vs freaking out, calling the cops, or taking radical action