There's a happy median.
Don't throw darts at employees who don't engage in dart throwing. Don't be excessively loud. Don't drum on other people's desks.
On the flipside: don't get angry when people aren't enforcing library rules around you. Use headphones as a signal that you don't wish to be disturbed (and to block out noise, obviously.)
Et cetera.
When its 6, though, you get caught up in conversation from the other folks, just when you're trying to get into flow.