Let me add a third perspective: like you, I have no problem doing those tasks in some light talking in the room. But the reason is because my brain is quite effective at completely shutting them off. Unless you directly address me, I can be right by your side and not actually hear a word you said to someone else. Hence the benefits of overhearing are completely lost on me.

Meanwhile, when I actually need to fully concentrate, even music can be distracting, so there's loss and no gain.