Re:ChatGPT is biased against resumes with credentials that i...
by marshray on Saturday June 22, 2024 @09:44PM
(#40763959)
> Reality is reality regardless of what you perceive.
Except that in nearly all nontrivial topics we only see a small sample of reality.
So even if we are lucky enough to be starting out with a set of only verifiable, reproducible, true facts, we are still biased in their selection.
Re:ChatGPT is biased against resumes with credentials that i...
by teaearlgraycold on Saturday June 22, 2024 @09:30PM
(#40763867)
Sure but if you randomly initialize weights you can keep shuffling the initial state to discover new local maxima. Baking in an informed starting state biases the results and requires a new biased start if you wish to explore other areas of the gradient. Basically, the student seems to have a reasonable approach. So how does the lesson follow from the preceding paragraph?
Re:ChatGPT is biased against resumes with credentials that i...
by skybrian on Saturday June 22, 2024 @09:48PM
(#40763981)
I think it's ambiguous because tic-tac-toe is a solved problem, so presumably it's being done as an exercise to learn something about neural nets.
If the idea were to write an AI to win at a harder game, it would make more sense to add whatever biases you can. You might get better performance that way. Or maybe that's what they thought back when that story was written? Game AI was nothing like we think about it now.
Re:ChatGPT is biased against resumes with credentials that i...
by holowoodman on Saturday June 22, 2024 @09:35PM
(#40763892)
Even randomness isn't unbiased. A random distribution will have local minima and maxima, just not in all the same places in the next try.
Presumably the argument is that training a neural net from a basis of complete ignorance is inefficient because we have facts with which we can initialize the model.
So far as applicability to TFA, we can and probably should initialize or bias models that select candidates so their inferences reflect our values.