The issue is using "Gypsies", period, when there's no need to do so.

If you replaced it with "Wanderers" nothing of value is lost.

Using a real group name is thr only reason your comment (and this one) exists.

It literally creates tension where none should be by its very existence. That's problematic.