I don't think the problem is other people noticing as much as thinking they're noticing. You can feel a bit weird if someone goes "beers for everyone?", everyone's agreeing and you're the one that has to go "no thanks, a coke would be nice". Or worse, just order it and put it in front of you. People do tend to assume everyone drinks beer.

(For me, that's not true. I don't mind alcohol, but I can't stand the taste of beer. I can't finish a zip of it, let alone a glass. I do sometimes have to explain that. Since I'm old enough to have a driver's license I sometimes have the nice excuse that I still need to drive. Works a bit better in that it requires less explanation.)