You can return the favor. Throw an "anti farewell party" after they have you back and invite everyone on the extended team. Maybe not necessarily a party, but you get the idea.