I think Thomas Sowell has some interesting scholarship on the topic, with regards to the roots of lower class culture in America.

If you look at this from a class perspective instead of race (hard in the current media environment) it makes sense.

Rather than focus on the white in “white trash” think about the word trash.