The pattern I've observed is that younger and more junior people want to work in the office, and older, more senior people with established networks, family life and nice accomodation with a home office are more likely to appreciate working from home.

This means that if you lose a lot of people because you start being stricter about working from home, then you'll probably disproportionately lose the senior people who are hard to replace and not lose very many of the young juniors who are easy to replace.