This seems like a limited view. I have worked and re-worked with people across multiple companies during my career. To burn bridges as you go through your career seems short sighted.