Allowing tracking would let kids who are not behind actually grow to their capacity. As it is currently structured, the kids at the top are never challenged, and they may not even realize that so many of their peers are also talented and unchallenged.
Teachers shouldn't have to teach a span of 3-4 grade levels. But in our district, the teachers and administration are the ones who are fighting hardest against tracking. It's not fair of them to fight tracking and then complain that teaching advanced kids would be too hard. It's only hard in the current system, where tracking (in our district) is not allowed.
But broadly we're in agreement, and the resistance you mention speaks to a broader, uncomfortable-to-discuss issue with the priorities educators have.