I think the worst thing for the child is that they aren't settled anywhere. It's one week, then you move and... do you have all your toiletries, what clothes do you have at this parent's, what different schedule and rules, how do I see my friends here, what's around this neighborhood.

Although, sometimes situations like that make you perversely stronger/more flexible/more mature. Adversity is a forge, in the right doses.