That's a pretty misleading way to summarize Charles Murray, who is probably America's foremost exponent of the Just World Fallacy, having written extensively about why blacks, women, and just about every other minority are in whatever diminished circumstances they find themselves in due to intrinsic deficiencies. Particularly blacks.

It could be true that it is not a "Just World" and also people are diminished by intrinsic definciencies.