That's just not true. It's not how economics/capitalism works. It's possible for both us "over here in the west" to benefit from "cheap labor" elsewhere, and for the people providing the "cheap labor" to benefit as well! It's a win-win in most cases, which is why over the last 40 years more people have moved out of poverty than at any other point in human history.

"if I were a garment factory worker making 100$/month under terrible conditions and long hours, then things might change -- I'd personally take my chances out in the wilderness."

Maybe that's true, but I think it's a bit ridiculous to suggest you would simply not be able to live in the same conditions 2 billion people live in and accept (they don't go out to the wilderness). Are you really so different that for you this will be such and impossible situation that you'd throw yourself to the wilderness?