I don't think its only psychological safety. If the top performers lose staff that did the mundane crap and now they have to do it they start to really pay attention to what the management is actually doing.

Every layoff I have ever survived the staff inevitably ends up talking about how so and so manager and his favorite buddies are still out golfing every friday. Why the f are they still here etc.

This resentment builds and builds.