News for hackers. Stuff that matters.
Re:Re-Evaluating GPT-4's Bar Exam Performance by paulcole on Sunday June 02, 2024 @04:25PM (#40556981)
> which I’d also argue LLMs suck at

OK, I’ll bite. What’s your evidence for this argument?

Re:Re-Evaluating GPT-4's Bar Exam Performance by lazide on Sunday June 02, 2024 @04:31PM (#40557020)
Every bit of interaction I’ve ever had with an LLM. And all the research I’ve seen.

They’re plausible word sequence generators, not ‘planning for the future’ agents. Or market analyzers. Or character evaluators. Or anything else.

And they tend to be really ‘gullible’.

What evidence do you have they could do any of those things? (And not just generate plausible text at a prompt, but actually do those things)

Re:Re-Evaluating GPT-4's Bar Exam Performance by paulcole on Sunday June 02, 2024 @04:55PM (#40557139)
> What evidence do you have they could do any of those things?

Every bit of interaction I’ve ever had with an LLM.

Re:Re-Evaluating GPT-4's Bar Exam Performance by Terr_ on Monday June 03, 2024 @03:31AM (#40560211)
Yeah, I fear a lot of human exuberance (and thus investment) is riding on the questionable idea that a really good text-fragment-correlation specialist engine can usefully impersonate a generalist "thinking" AI without causing too much damage. ("LLM, which rocks are the best to eat?")

It gets worse: Some people are assuming an exceptional text-specialist model can also meta-impersonate a generalist model impersonating a specific and different kind of specialist! ("LLM, create a legal defense.")