News for hackers. Stuff that matters.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by sebzim4500 on Friday April 21, 2023 @08:42AM (#35652847)
Seems too good to be true, and I don't understand what it even means for an LLM to be unbiased.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by hospitalJail on Friday April 21, 2023 @09:45AM (#35653646)
They could use different models to test it. They could use common biases and test those.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by Turing_Machine on Friday April 21, 2023 @09:55AM (#35653796)
"Unbiased" almost always means "has biases that are similar to mine". I can't think of very many exceptions to that, frankly.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by flangola7 on Friday April 21, 2023 @11:10AM (#35654965)
That's obviously untrue after more than three seconds of critical thought
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by __MatrixMan__ on Friday April 21, 2023 @11:57AM (#35655715)
It's not obvious to me. If you have a proof that it's possible to have unbiased views of objective reality, please share it.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by sebzim4500 on Friday April 21, 2023 @03:10PM (#35658571)
I've thought about it for four seconds now and I still agree with him. Maybe if you shared an example instead of a unsubstantiated put down it would help.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by henri18 on Friday April 21, 2023 @09:57AM (#35653820)
There are many bias detectors developed in the research world. To have a deeper look, you can look at this paper: https://arxiv.org/abs/2208.05777
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by thfuran on Friday April 21, 2023 @09:58AM (#35653842)
One with only weights and no biases in the ANN is unbiased.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by taneq on Friday April 21, 2023 @10:05AM (#35653956)
I feel like this went underappreciated. [b] = [0] indeed.
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by sebzim4500 on Friday April 21, 2023 @03:07PM (#35658518)
Someone I know thought that LLaMA was unbiased because they 'read' the paper and clearly didn't know what anything meant. A great example of "a little knowledge is a dangerous thing".
Re:SafeGPT: New tool to detect LLMs' hallucinations, biases ... by taneq on Friday April 21, 2023 @10:04AM (#35653945)
It doesn't. Mean anything, I mean. Language isn't well defined, so its accuracy is also undefined and a non-uniform deviation from that accuracy is super undefined.