Look no further than the United States and its historical relationship with labor and corporations (when its government was much smaller), for the reasons you just quoted.
I'm not saying "big government" guarantees the opposite, but corporations have already shown us what they will do with less restrictions and oversight. They'll fill spice cans with dust and sell it as black pepper. They'll penalize break time so heavily that workers will have to defecate where they stand in the sausage plant. They'll pay as little as possible and almost-starve their employees so that they have no energy or resources to do anything except continue working.
So was the rest of the world, especially for those not in power.
> U.S. still attracted plenty of "dirt-poor and ugly" immigrants from all over the Western world
True, but also many folks' options weren't exactly great in comparison.
> Can't really say the same about "big-government" countries at a similar level of wealth today.
Germany, the Scandinavian countries for instance is an often-desired place for immigrants. The US is still a very desirable place for immigrants, even though the size of the government has grown.
Ah, but who's more likely to do these things? Free corporations that must vigorously compete against any new upstarts, or corrupt ones led by government cronies, that can easily erect a convenient "moat" against competition, fully supported by government coercion? Hint: look at which countries do these things in practice. It's not the "small government", economically free ones.