The law requires certain accommodations for students with disabilities and local elections should handle the rest. All that requires is an engaged community and parents can be extremely vocal/involved. Cities can have good reason to lean on schools too, because good schools bring people into an area and they bring money with them. In that sense, public schools do compete. Families and young adults looking to start them don't want to move to areas without good schools.
Incentives are there, it just takes work and paying attention. A lot of people don't even bother voting in local elections and those that do don't always give much thought to who to elect as superintendent or to the school board. When communities don't take the time to invest in their schools they don't get much out of them. It's part of the reason why poor communities that lack the time/money/energy to be as involved tend to have poorer quality schools. Adding to that are the wealthy families that move to where schools are better or don't move into those areas at all.
Everyone voting with their feet is functionally equivalent to removing the disruptive kids from class, even though it might not seem like that if one has ideological blinders on.
The problem is that public schools can't do those things, for various political and social reasons. So the charter school thing is a workaround.
>If public schools aren't doing this, there needs to be changes in administration,
Again, this is a political problem, since administrators are picked by the local government. There's only so much administrators can do anyway. Ultimately, the whole thing seems to be a political and a cultural problem.
So, yeah, it is a political problem.
Charter schools aren't needed for that though. Public schools are supposed to already be doing it. Either in the form of escalating suspension followed by expulsion or by moving the most problematic kids into emotional/behavioral disability classrooms and schools or in the worst cases sending the children to hospitals and group homes.