News for hackers. Stuff that matters.
Re:What does it mean when an LLM “hallucinates” & why do LLM... by chrisjj on Tuesday August 22, 2023 @09:23AM (#37222347)
> LLM hallucination occurs because the model's primary objective

Stopped reading here. A model has no objective. It has only output.

The only objective is on the part of "AI" marketeers and it is there that the euphemism "hallucination" originates.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by neilmock on Tuesday August 22, 2023 @09:42AM (#37222583)
No, it has only input. Divergence from reality (insofar as it can be centered) is a hallmark of human thought as well, so perhaps the models are simply performing.
Re:What does it mean when an LLM “hallucinates” & why do LLM... by JimtheCoder on Tuesday August 22, 2023 @09:36AM (#37222518)
"A model has no objective. It has only output."

Is creating output not an objective?

Re:What does it mean when an LLM “hallucinates” & why do LLM... by Wicked_Engineer on Tuesday August 22, 2023 @09:46AM (#37222637)
Objective signifies intent, no?
Re:What does it mean when an LLM “hallucinates” & why do LLM... by jwestbury on Tuesday August 22, 2023 @10:05AM (#37222908)
Maybe, somewhere, in the minds of the creator of the model.

But an objective function is a core element of ML models, no? And LLMs have objective functions, so far as I'm aware.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by gremlinsinc on Tuesday August 22, 2023 @10:16AM (#37223036)
Sure, but it doesn't need to be organization the LLMs objective. A soldier could have an objective that they don't agree with or didn't choose themselves.

In star Trek there's the prime directive, the enterprise crew follows it because it's a core requirement of the federation.

Just because the LLM has an objective to answer queries for example does not mean it chose it. or has the intent itself as sapient being would.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by rcxdude on Tuesday August 22, 2023 @09:42AM (#37222590)
It's reasonable to call minimising the training loss function the "objective" of the LLM, I think (said loss functions are often called objective functions, after all), though we must careful that the overloading such term in an anthropomorphic fashion. Whether "producing clear and coherent text" is a good characterisation of a "predict the next token" loss function is another question though. I would say it probably isn't, but it's a resonable hypotheses to say that the nature of the training is why the output tends to bias towards plausible but incorrect text as opposed to some variation of "I don't know".
Re:What does it mean when an LLM “hallucinates” & why do LLM... by gharman on Tuesday August 22, 2023 @12:55PM (#37225479)
Agreed there is a semantic argument here. I don’t think anyone is anthropomorphizing LLMs. I’ve had to adopt “objective” with one customer instead of “task” (my preferred default term) because their industry overloads “task” with something else. Now that said, as you point out, the real objective is next token prediction not “help the user with a truth bomb.” and it just happens to have emergent accidental usefulness (I think a natural bias from the training data).

They (chatgpt et al) do move closer to “clear and coherent” by adding extra layers such as a beam search on LLM outputs. Good to remember that ChatGPT et al are products, not bare metal LLMs.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by chrisjj on Tuesday August 22, 2023 @02:29PM (#37226751)
> I don’t think anyone is anthropomorphizing LLMs

The "AI" marketeers' use of "hallucinate", "objective" and "predict" does precisely that.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by chrisjj on Tuesday August 22, 2023 @02:25PM (#37226704)
> It's reasonable to call minimising the training loss function the "objective" of the LLM

This article isn't doing that, though. What it is calling the model objective is "producing clear and coherent text".

> Whether "producing clear and coherent text" is a good characterisation of a "predict the next token" loss function is another question though.

I agree. But lets us be clear that prediction too is a misnomer. Simply generating a word coherent with prior words is not prediction.

Re:What does it mean when an LLM “hallucinates” & why do LLM... by swexbe on Tuesday August 22, 2023 @09:46AM (#37222644)
Objective as in objective function.
Re:What does it mean when an LLM “hallucinates” & why do LLM... by chrisjj on Tuesday August 22, 2023 @02:31PM (#37226769)
So "LLM hallucination occurs because the model's primary objective function is to generate text that is coherent and contextually appropriate"?

I'm not buying :)