Edit: Specifically, if the goal is to help sex workers who want help, the solution is... to help sex workers who want help. It's to perform research into the barriers to seeking help, and try to remove those barriers. It's not to prevent consensual trade between a person who has few issues with their job, and someone seeking their services.
If, on the other hand, the goal is to eradicate sex work against the wishes of those sex workers for reasons of morality, punishing people who participate in it is a wonderful idea.
Which rights does consensual sex work curtail?
This isn't really an opt-out right; surely there are people who would "consent" to situations of slavery or apartheid. This doesn't mean we should make those things legal.
If you want to disambiguate it from sex, consider whether someone should be able to sell (and thus another person to buy) an organ.
Then consider that the demand for purchasing sex massively outstrips the demand for purchasing organs.
Selling sex doesn't imply the loss of anything.
Literally thousands upon thousands of current and former prostitutes disagree.
The solution is not to make sex work illegal, or to make seeking it illegal. It's to help the people who don't want to be performing sex work. It's to give them food, and shelter, and training to re-enter the job market. But that's expensive, and it's difficult to explain to people with Christian moralities about sex why you'd allow people to perform sex work if they wanted to.
I do. I reach out to would-be purchasers of sex and those who would defend them, and point out the dire consequences of their approach. Economic transfer doesn't suddenly make rape something one should aspire to or tolerate.