There is a thin line between saying that very few people would make a choice, and very few people should make a choice. You are correctly asserting that you said "would" not "should", but others are correctly pushing back and saying that it is a common rhetorical technique to say one when actually meaning the other. If you meant what you said in a non-normative manner, you may need to emphasize this fact to prevent the more common reading.
Separately, I'm sure some people question whether you are correct that few would choose this lifestyle, and if so, why this would be. Personally, I think you are right that few would choose to work as prostitutes but that the reason is the societal stigma associated with sex work. I don't know how popular the choice would be if the stigma would be removed and the pay remained high. You seem to be asserting that it would remain extremely unpopular, but I'm not sure that's correct.
Alterations of the position:
"While I'm in favor of people engaging in worship, I don't think anybody worships Mohammad with a healthy attitude towards the lord. They're typically victims of religious indoctrination at a young age, which has warped their perception, leading them to believe in a false god"
"While I'm in favor of people having freedom, I don't think anybody uses narcotics with a healthy attitude towards their health. They're typically victims of immoral liberal households at a young age, which has warped their perception, leading them to believe that drugs are OK"
Basically, you're making a moral decision and saying that anybody that ends up making a contrary decision for themselves must be damaged due to their upbringing.