Where does this nonsense end? If (almost) all my co-workers are staring at me as I adjust my belt, standing in the middle of the lunch room, I will do that activity in the confines of a men's room next time. If the same thing happens as I stretch my leg muscles before a run, I will do that activity outside. Why is it my co-workers' fault if they stare at me if I do something that is not the norm?
If being merely 'looked at' troubles you, then you need to look at yourself before closing others' eyes.
"Why are you uncomfortable?", should not be that hard a question to answer, clearly and succinctly, for something that evokes such a strong response from you.
Impossible. You can pick your friends, you can pick your nose, but you cannot, however, pick your friends' nose.
"What a hostile environment that coworkers tell me to not hula hoop in the office!"
You can't win with some people or environments.