It isn't a big deal to wear a mask all the time. I wear one in my workshop when alone all day. I semi-regret donating all my N95 masks last spring - I still cannot get good replacements and I'm allergic to sawdust. There is no harm in wearing a mask when you don't need to. there is harm in messing up some borderline cases. So just get used to it on your face and forget about it.