I'm missing something in your anecdote - at what point did you and your current coworkers leave? Who was the employee that hired them?

If you built a team for the benefit of your company on company time, and that team decides to leave as a whole, that's one thing. If you spend company time on recruiting people to another company, that's very different!