I come from a poor family and now my family is no longer poor because of my work. I wouldn't say I'm smarter than the average person, but somehow I'm luckier. But with that said, I don't seem to be even smart enough to realize what unconscious bias you're referring to, care to spread some light for me?

They use "smart" as the opposite of "poor", which implies that they see "poor" as pretty much synonymous with "stupid".