I don't think you understand the concept of "privilege" very well.

Privilege is basically the logical inverse of discrimination. If driving while black means getting pulled over more (discrimination), then driving while white means not getting pulled over more (privilege).

Hope this clarifies how even poor whites are "privileged".