Possibly. As an Indian I'd just appreciate it if people were given the opportunity to have a dialogue around this. I agree that there are many cases where such dialogue is not warranted, of course.
A reply to your comment is perhaps not the best place for this, since I don't disagree with you, but am merely trying to have a somewhat relevant yet ultimately orthogonal discussion.
Personally, I've been forced to give it a wide berth for obvious reasons, as I imagine many Indians you know have too. However, if you came into my home you'd be able to find a few swastikas — I'm not even religious, it's just on gifts from friends and family.
> I've worked with a lot of Indians and never saw any of them wear a swastika necklace
Most Indians don't wear it, but that still leaves a lot who do. I'd also imagine that there's some selection bias going on when you consider only the people you've worked with. If you googled it you'd have noted that most images are clearly of pendants.
It's probably good to have a dialogue about it, and you should note the person's ethnicity as well.
Try Google imaging "hindu lucky symbol." I'm not entirely convinced that a people should be forced to entirely give up on a symbol they were using first, before it got misappropriated.