Sex work is correlated with poverty and mental problems. Of course people are going to think such an individual is likely to be an unfit parent.