The only thing that defines whether you are a good or bad person, is what you do at a personal level. Even though I may contribute to horrific consequences on a business level, at the personal level I am still a good man.
I'm all for cutting people slack for systematic issues, environment, zeitgeist etc. But just giving it a free pass because it's business seems very wrong. Most of the bad things in this world are "just business".
Today’s equivalent might be H1B Visas, which many companies in the valley make ample use (and even abuse) of.
Slaves are mistreated by definition of being slaves.
It's true that on some level, we exist within a system that forces us to make bad choices, and in general I think criticising individuals for systemic issues is a waste of time, but you can't just say "it's just business" to dismiss all moral decisions.
If you are working for a company which you know to be causing harm, and you are in the privileged position to be able to leave without becoming destitute, choosing to keep working for them is absolutely an action which can be morally condemned.