When you flag something, does it disappear immediately, or only if it's received enough flags to be killed? If the latter, then I think this is much less of a problem. Sure, you may have flagged it by accident, but if it was only one flag away from being killed, it'd probably end up getting intentionally flagged again by someone else soon enough.
I honestly thought they got removed but it looks like this isn't happening for me (at least not right away), unless it's the scenario you mention where it's only one away from being killed. I think I must have been conflating the behaviour for hide with flag.
There's a reason why the emergency services requires you to enter three digits when dialing. Sure it would be a smoother flow if you only had to press a single button or dial '9', but you'd also get a lot more butt dials.
I'm not really a fan of dialogs in flow if it can be avoided, at least not without trying other indicators first, but I would agree some UX experimentation might be worthwhile. Like rather then have it simply go to "unflag", a two letter difference purely in gray, also have it turn bold/bright red for an hour? At least as an option? I just tried playing with the CSS and flagging/unflagging your post, and setting [unflag] to color:red;font-weight:bold makes a real difference without being obnoxious.