As someone who does a similar thing, I get this a lot. One of the most concerning (and common ones) is "oh, do you work here?".