Im a guy, who was happy to bring his daughter to work (5 at the time) every now and again.

One day I left her in my office, while I went to a meeting. When I came back she was GONE. A quick lap around the office and I could not find her. Another lap and I spotted her. She was in my bosses office coloring. He, and her were having a grand old time, and he clearly found my distress "amusing" as I really had nothing to be worried about.

As someone who thinks kids in the office every now and again is a good thing, there are limits. For me it would be a conference, and it might be for others as well.