Just adding another data point — I've gotten coffee outside of the building (at a cafe) alone with male colleagues, both multiple and one-on-one, and it's always been fine.