Saying unwashed before most words standing in for people would likely not be a nice thing to say. So of course unwashed masses isn’t a good phrase. Nor is “unwashed people”