Some of us are more likely to worry about work not getting done than others. When those same people also have less general need for social interaction, that 'friendly interruption' feels like a selfish demand to meet your greater need for social interaction at the cost of my own need for lack of worry about the thing I get paid to do.