Basically I think that as long as the conversation is interspersed / mixed enough that I can't easily understand what people are talking about, then I think it's not thought disruptive, and even beneficial in that case - I agree when people are talking loud / clear enough that you are basically a third listener in their conversation that it can be less than ideal.