Inverters that see excess frequency make a point of lagging. Collectively, they can bring the frequency back in line, just as control systems in rotating machinery do.
The rotating machines are wholly as dependent on controls as the inverters.
A grid without rotating generators would act differently, for sure, as you won't have varying frequency to indicate if the grid is overloaded - you'd have to rely on different measures to understand how close parts of it might be to failure.
"Bad actors" in the grid can already cause severe problems regardless of spinning generators; if a power station goes offline the unexpected load spike can easily trip off most of the grid anyway. Smaller, distributed generators/inverters if anything are more reliable, as a fault in one is less likely to constitute an outsize portion of power generation. "Grid inertia" today is largely a result of the total machinery attached to the grid just massively outweighing any individual actor.