Because of exactly that, the creators of the original implicit bias test have said it should not be used the way it has been. I think they've pretty much said the test is worthless.