I've had people drop out after accepting an offer from me that I still chat with and have relied on for reference calls (they're a manager now). It's really not a big deal, if they got a better offer somewhere else I wouldn't want them to feel like they're stuck with my company, that's not going to be a productive relationship anyway.