Re:Re-Evaluating GPT-4's Bar Exam Performance
by lazide on Sunday June 02, 2024 @04:31PM
(#40557020)
Every bit of interaction I’ve ever had with an LLM. And all the research I’ve seen.
They’re plausible word sequence generators, not ‘planning for the future’ agents. Or market analyzers. Or character evaluators. Or anything else.
And they tend to be really ‘gullible’.
What evidence do you have they could do any of those things? (And not just generate plausible text at a prompt, but actually do those things)
Re:Re-Evaluating GPT-4's Bar Exam Performance
by paulcole on Sunday June 02, 2024 @04:55PM
(#40557139)
> What evidence do you have they could do any of those things?
Every bit of interaction I’ve ever had with an LLM.
Yeah, I fear a lot of human exuberance (and thus investment) is riding on the questionable idea that a really good text-fragment-correlation specialist engine can usefully impersonate a generalist "thinking" AI without causing too much damage. ("LLM, which rocks are the best to eat?")
It gets worse: Some people are assuming an exceptional text-specialist model can also meta-impersonate a generalist model impersonating a specific and different kind of specialist! ("LLM, create a legal defense.")
OK, I’ll bite. What’s your evidence for this argument?