Yes, and Mozilla choose to fight for the freedom of the web not for human rights.
Amnesty international for people rigths and not for dophin right.
Greenpeace for the environment and not for the freedom of the software.
Nobody fight for everything, choose a niche and fight for that.
I'm not arguing that they shouldn't be working with Foxconn, I'm trying to take the discussion out of this specific context.
My point is that just because human rights is not their goal, it doesn't mean it can't be a consideration. And if Foxconn, rather than being a company with a somewhat poor track record regarding its staff, was a company known for funding terrorism, arms sales, etc. then I don't think anyone would be arguing that people shouldn't do business with them.
On a personal level, many people chose their friends/acquaintances based on these sorts of things. On a consumer level, there are many examples of popular boycotts (for example see http://en.wikipedia.org/wiki/Nestl%C3%A9_boycott or http://en.wikipedia.org/wiki/Anti-Apartheid_Movement ). On a company level, many companies consider things such as environmental or social duties when deciding who to do business with.
In all cases, it could be because you hope that such a decision will cause change (e.g. organised/promoted boycotts) or it could be simply that you don't want to support something bad, even if knowing that refusing to spend $1 on some Nestlé chocolate (for example) probably won't change a thing.