News for hackers. Stuff that matters.
Re:Horse-riding astronaut is a milestone in AI’s journey to ... by brudgers on Friday April 08, 2022 @02:48PM (#30961026)
AI is an ideology, not a technology.

Part of the ideology is the ends justify the means.

Hence, "AI training specialist" means "works for Amazon Mechanical Turk."

Open AI isn't paying people $250k a year to classify images.

And $500k a year to check that work.

The AI ideology is God will know his own.

A racist, misogynist, hillbilly singularity meets success criteria.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by seizethecheese on Friday April 08, 2022 @03:04PM (#30961203)
This is nonsense. It’s just generating the most likely image. Probabilities are not in and of themselves racist/misogynist.
Re:Horse-riding astronaut is a milestone in AI’s journey to ... by krapp on Friday April 08, 2022 @03:32PM (#30961511)
Bias in data leads to biased probabilities. Bias in data reflects biases in the systems that data describes, and the people describing it.

One could say (and some have said) that the tendency of some facial recognition software not to recognize black faces is not racist - but simply a matter of physics. What's racist is the culture of software engineering which only tests that software on white faces, and doesn't consider it a problem.

Likewise the 'most likely image' of a nurse being a non-white female and a CEO or lawyer being a white male is still a problem even if it accurately reflects racial and gender class role biases in society. Eventually these systems will enforce and maintain power structures and media narratives which themselves are already built upon racial and gender prejudice.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by ARandomerDude on Friday April 08, 2022 @03:55PM (#30961776)
> What's racist is the culture of software engineering which only tests that software on white faces, and doesn't consider it a problem.

That's a pretty cynical take. Every project I've ever worked on, regardless of the problem domain, operated with the 80/20 rule in mind. Solve the easy problems first, get something out the door and then work on the harder problems. If dark skin is a harder problem in image recognition, it doesn't mean a developer is racist for solving the easier parts of the problem first.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by ganzuul on Friday April 08, 2022 @04:08PM (#30961930)
By the time you get to the minorities the majority has moved on and your company pulls support on the non-profitable minorities.

Did you become an engineer to work on easy problems?

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by krapp on Friday April 08, 2022 @05:09PM (#30962560)
The normalization of whiteness as default which leads to the attitude that considers facial recognition software which only works on white faces to be complete enough to ship, rather than fundamentally broken, is where the racism comes in.

Racism doesn't always come from overt bigotry or hatred. It can be expressed by simply accepting the status quo of systemic bias, because it's less work, or more cost effective, than doing otherwise.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by 8bitsrule on Friday April 08, 2022 @04:16PM (#30962025)
> still a problem even if it accurately reflects racial and gender class role biases in society.

Agreed, but. Since the 'culture of software engineering' likely reflects society-at-large (maybe a step up) ... how do you construct training models that reflect a more refined and caring reality than the one we've got?

If what they're showing us accurately mirrors what they're seeing, that's a service. If we find it painful, well, we made it that way.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by brudgers on Friday April 08, 2022 @06:11PM (#30963134)
The obvious solution is to set such results among the short term goals and to treat failure to meet the criteria as unacceptable engineering failures.

As simple as no bonuses, no stock options, no promotions and most importantly no deployment if the model produces undesirable results.

The models reflect what AI ideology directs Amazon Turks to find. It reflects what is considered accurate and does not reflect classifications that might be perceived to put Amazon Mechanical Turk’s contracts at risk.

“We” didn’t make it that way because I know I am not using Amazon Mechanical Turk to classify images.

I mean even if the exploitive wage structure went away, the name itself is consistent with AI ideology that racism, religious intolerance, and nationalism are ok.

Re:Horse-riding astronaut is a milestone in AI’s journey to ... by pengstrom on Friday April 08, 2022 @03:08PM (#30961246)
They are the results of human design though. We have to aspire for more than bias laundering, otherwise we risk the biases multiply
Re:Horse-riding astronaut is a milestone in AI’s journey to ... by ganzuul on Friday April 08, 2022 @04:03PM (#30961863)
ML trained on real world data is an uncompromising unveiling of our collective subconscious. Don't you dare look away...

There is no God but you and me here.