Maybe. But I would argue that most people's talent is the result of persistent hard work in that discipline. And that is a compliment.

Sometimes people use "I'm not a designer" as an excuse for why they aren't good at design, as if it's something you need to be born with. It could be that they've just never cared enough to try, but to make themselves feel better they dismiss it as an impossibility.

When you're looking far up the ladder it's tempting to call it a gift at birth--when you're only a notch below, it's easier to see it as the result of hard work. What drives those people is another question.