"Having no political agenda" often turns out to mean agreement with/uncritical acceptance of the dominant political agenda. The status quo is perceived as a natural order or default state of the world, instead of the result of the current distribution of influence and the ideology of those in power. Thus proclaiming "neutrality" is often in fact a statement of conservativism / siding with the currently privileged / rejecting any motive for progress. If you (fail to) calibrate your world view like that, criticizing the progressive left or at least equating the left and the right-of-what's-mainstream as equally unnecessary/hysterical/dismissable "extremes" follows.