He means he doesn't identify as a (s)ocial (j)ustice (w)arrior: that is, regularly and loudly taking umbrage and outrage at perceived social inequities.

But he still wants to point out a racial property that may have influenced his experience.