In a homogenous group discovering who is and who isn't could easily pass as a playful endeavor, whereas in a diverse group it's more likely to be seen as a shocking insensitivity. Not just by those affected (who might very well be perfectly absent) but also by those who think someone might be affected.