Working a job that makes the world a worse place because you need to survive is the issue.

It IS less evil to do nothing and be fed than to take up arms in a factory that produces produces that people want, but is poison (cigarettes, as an example). Paying people to prevent exploitation from plantation owners is a good thing.