They most likely didn't say anything out of fear of becoming the target of the group. What happened to you sucked, but groups of men that are shouting racist things and are obviously drunk are just a huge risk for anyone.