I led a team of about 65 engineers at my previous job. One of things that became apparent at around the 20 mark was that rumors spread so quickly and a comment I didn't think twice about crystallized into "marching orders" very quickly.

Make jokes, it helps build rapport with people you spend so much time with! But be careful about the message you convey, people will run wild with it overnight.