We had this in flowdock before we switched to slack, on a team of probably 700 or so at the time. It made it far easier to filter out chatter when dealing with an urgent issue (no need to change rooms or remind people to be quiet for a while), and I haven't really noticed it encouraging pointless chatter. I seriously miss this feature in slack.