> how do these companies determine which are the unproductive devs?

The senior management delegates. At every moment your direct manager knows whom they are willing to part ways with if asked. Even if everyone on the team is great there is always some criteria (costs, impact on important project, institutional knowledge) that sets some people apart.