News for hackers. Stuff that matters.
Re:OpenAI's Woke Catechism by thesuperbigfrog on Friday December 23, 2022 @03:04PM (#34110018)
"Did you train the model using real world data?"

"Yes. We want the model to be useful in real world applications."

"Then it is biased. The model is biased because data it was trained on was generated by people and people are biased. There is no such thing as an 'objective' model, just a model that is biased in a different way."

Re:OpenAI's Woke Catechism by kelseyfrog on Sunday December 25, 2022 @12:21AM (#34124541)
Yep. It's fundamentally impossible to create a LLM that isn't biased in the same way it's not possible to create any strand of interesting text that isn't also biased.

It's simply not possible. Not for AI. Not for humans. I'd challenge anyone to attempt to try.

Re:OpenAI's Woke Catechism by throw9986bbdhi on Sunday December 25, 2022 @03:38AM (#34125445)
This is not really correct. Humans make systematic errors of judgement (bias), which is reflected in texts. But you could still imagine an AI unbiased, "perfectly modelling" this "biased" data (retrieving the "true model" behind this data).

Not that I endorse this article either.

Re:OpenAI's Woke Catechism by thesuperbigfrog on Sunday December 25, 2022 @09:57AM (#34127737)
> you could still imagine an AI unbiased, "perfectly modelling" this "biased" data

Imagining something is different from building a working system.

In beginning physics courses, students learn the fundamentals of Newtonian mechanics using frictionless point masses, but no one has built one for the students to use in the hands-on labs.

If bias goes into a model through the training data, bias will come out when the model is used.

The only unbiased models are untrained models, which are not very useful.

Re:OpenAI's Woke Catechism by Reefersleep on Sunday December 25, 2022 @01:28PM (#34129706)
Your comment has me pondering. Is there such a thing as an unbiased human experience, let alone an unbiased human utterance? Everything we do is informed by the past, however indirectly and outwardly unpredictable.
Re:OpenAI's Woke Catechism by darthrupert on Monday December 26, 2022 @01:47AM (#34135362)
Reality has a well-known liberal bias.
Re:OpenAI's Woke Catechism by kbelder on Tuesday December 27, 2022 @02:18PM (#34152569)
Modern or classical?
Re:OpenAI's Woke Catechism by darthrupert on Thursday December 29, 2022 @12:21PM (#34175038)
Yes!