This "brown people" phrase is commonly used to disparage concerns about incompatible values and cultural norms. And this is probably only context where I see middle easterners grouped like this.

Not GP, but I do consider this to be low-key racist and aaomidi to be somewhat racist, but maybe for different reason than GP.