A civilian who does not actively protest their government is not neutral, but they are not as complicit as the active participants.
Refusing to take a stance benefits the status quo. The status quo is not “neutral”.
If neutrality exists in some arrangement other than the status quo, isn't that vision of what could be necessarily a political one, and therefore not neutral?
No. It does not. It is, and has always been, an illusion of the privileged.
It's also not "if you're not with us you're against us." It stems from a genuine analysis of how systems work, especially systems of oppression.
No one is exempt from politics. No one can avoid being part of the system, one way or another. It's just that some people are privileged enough that the status quo supports us in ways they never ever notice, the way we never stop and think about the air we breathe. Others aren't so lucky: their continued existence is labeled by many as "political", especially if they want to be seen in public or involved in government.
If I’m understanding you correctly, what your saying is: every decision has some transitive implications that are statistically non-neutral so all actions are non-neutral. In a mathematical sense this is true in the same way that a uniforming sampling of a real number from -1 to 1 will never be zero. In the general sense that people use the word neutral though that’s not true. Because people use the word in a broader sense. And in this analogy it’s like saying neutral is 0 ± 0.1.
Additionally intent, responsibility, and free will play a part in this. A doctor healing a soldier is a noncombatant because they’re not responsible for the behavior of another human (who’s own decision making could change and could turn to corrective actions for example through surrender or informing).