The dangerous piece of this is executives who don't have a solid grasp of how things are operating can assume that a product still running after the departures is still successful. Validates their decision making even as things deteriorate in the background.

That said you can replace people and build back that institutional knowledge -- both loss and gain take significant amount of time.