Even the highest karma users can lose their flagging privileges, temporarily or perhaps even permanently, if they do it enough times within a time window or if abuse is detected. So from what I understand that issue should be taken care of.