As someone who ran servers on a few large IRC networks (Dalnet, Undernet and Espernet) as a teenager, I wholeheartedly agree. The temptation to abuse even this trivial amount of power turns rational adults into monsters. It also makes you a target for all the “undesirable elements” on the server (think DDoS, swatting, etc) if you try to do anything about it.