Yep anything that engages your language processing: speaking, listening to conversations, singing, etc. interferes with your ability to process what's going on in front of you. Carrying on any sort of conversation, hands-free or no, impairs reaction time and your ability to drive safely.

You're not supposed to talk to bus drivers without good reason, and this is partially why.