You'll get confusion whenever you don't do something that is part of the standard human experience. Drinking, having children, getting married, dating, not eating meat, etc.

Most unreasonable behavior as a reasonable reason behind it. Never drinking is unreasonable without significant personal/religious reasons. People are understandably curious about your reasons, which generally wouldn't be good small talk (e.g. it killed my X).