The thing about that word "smallfolk", is that there is a very heavy connotation that someone remains smallfolk no matter how positively fortune smiles upon them. No matter how wealthy they might become, not even if they can ride a dragon, do they suddenly become nobles.

The people using the word to say that Kimmy D isn't smallfolk don't even understand the vocabulary they favor.