Why is it annoying? If I'm addressing a team of 5 people, I would much rather say that person A is amazing at math than tell 4 others that they suck at math.

Social skills are a thing, even if they're logically equivalent statements.