There's a bit of conflation between cause and effect here.

Seems he was just saying that those with strong accents were less successful in previous rounds. That certainly could be due to prejudice in society at large, but it still would be a valid predictor.