These protests and riots are happening precisely because the alternative mechanisms such as the one you are suggesting have failed time and time again.

Here in NYC we have a spineless mayor who has completely given up even attempting to exert civilian oversight on the police since 2014. They have free rein to do whatever they want and to "self-police" themselves, and because of the union violent cops are never fired.