This seems to be ignoring reality. If you're born in a locality without options to grow your own food, or don't have a farm to inherit, these aren't actually options.
And actually, a lot of poor people have been forced off their lands, when lucrative commercial interests have swayed law-makers and bureaucrats. Property rights aren't quite the same in poorer countries.
> You're not going to solve sweatshops by taking away people's agency.
Obviously.
> You get rid of them by providing viable alternatives.
I'm not sure how this fantasy become reality without protectionist government intervention, or the whole world deciding they won't buy cheaper socks because they aren't certified fair trade. I'm pretty certain which one of those two is more likely though.
You're not going to solve sweatshops by taking away people's agency. You get rid of them by providing viable alternatives.