News for hackers. Stuff that matters.
Re:GPT-5 is behind schedule by croes on Monday December 23, 2024 @12:54AM (#42492156)
Experience. If I recognize they give unreliable answers on a specific topic I don’t question them anymore on that topic.

If they lie on purpose I don’t ask them anything anymore.

The real experts give reliable answers, LLMs don’t.

The same question can yield different results.

Re:GPT-5 is behind schedule by TeMPOraL on Monday December 23, 2024 @02:33AM (#42492561)
So LLMs are unreliable experts, okay. They're still useful if you understand their particular flavor of unreliability (basically, they're way too enthusiastic) - but more importantly, I bet you have exactly zero human experts on speed dial.

Most people don't even know any experts personally, much less have one they could call for help on demand. Meanwhile, the unreliable, occasionally tripping pseudo-experts named GPT-4 and Claude are equally unreliably-expert in every domain of interest known to humanity, and don't mind me shoving a random 100-pages long PDF in their face in the middle of the night - they'll still happily answer within seconds, and the whole session costs me fractions of a cent, so I can ask for a second, and third, and tenth opinion, and then a meta-opinion, and then compare&contrast with search results, and they don't mind that either.

There's lots to LLMs that more than compensates for their inherent unreliability.

Re:GPT-5 is behind schedule by discreteevent on Monday December 23, 2024 @03:57AM (#42492939)
> Most people don't even know any experts personally, much less have one they could call for help on demand.

Most people can read original sources.

Re:GPT-5 is behind schedule by signatoremo on Monday December 23, 2024 @06:36AM (#42493676)
Which sources? How do I know I can trust the sources that I found?
Re:GPT-5 is behind schedule by brookst on Monday December 23, 2024 @07:43AM (#42494005)
And yet here you are making an unsourced claim. Should I trust your assertion of “most”?
Re:GPT-5 is behind schedule by a1j9o94 on Monday December 23, 2024 @08:26AM (#42494218)
How do you even know what original sources to read?
Re:GPT-5 is behind schedule by skydhash on Monday December 23, 2024 @01:30PM (#42496528)
There's something called bibliography at the end of every serious books.
Re:GPT-5 is behind schedule by ben_w on Monday December 23, 2024 @05:23PM (#42498090)
I am recalling CGP Grey's descent into madness due to actually following such trails through historical archives: https://www.youtube.com/watch?v=qEV9qoup2mQ

Kurzgesagt had something along the same lines: https://www.youtube.com/watch?v=bgo7rm5Maqg

Re:GPT-5 is behind schedule by TeMPOraL on Monday December 23, 2024 @09:15AM (#42494501)
They can, but they usually don't, unless forced to.

(Incidentally, not that different from LLMs, once again.)

Re:GPT-5 is behind schedule by nuancebydefault on Monday December 23, 2024 @07:16AM (#42493858)
It's not that black and white. I know of no single person who is correct all the time. And if I would know such person, i still would not be sure, since he would outsmart me.

I trust some LLMs more than most people because their BS rate is much much lower than most people I know.

For my work, that is easy to verify. Just try out the code, try out the tool or read more about the scientific topic. Ask more questions around it if needed. In the end it all just works and that's an amazing accomplishment. There's no way back.