Yeah, I work that way as well. I have a nice pair of noise canceling headphones, and my co-workers (non-programmers) will have to tap on my shoulder or speak loudly for me to hear them.

They're often perplexed if I'm late to a meeting or aren't up to date on the latest email. I generally keep Outlook closed which manages my calendar and email.