News for hackers. Stuff that matters.
Re:How outdated information hides in LLM token generation pr... by freehorse on Sunday January 12, 2025 @07:54AM (#42673228)
> it could know that something is more commonly cited based on its training data

No there is no such concept or way to do something like that. LLMs do not have such kind of meta-knowledge over their training data or weights. But there could be explicit mentions about this on their training data and they could pick on that and that is probably the simplest explanation.

Re:How outdated information hides in LLM token generation pr... by og_kalu on Sunday January 12, 2025 @11:12AM (#42674556)
>LLMs do not have such kind of meta-knowledge over their training data or weights.

Not sure this is a claim that can be confidently made.

https://arxiv.org/abs/2309.00667

https://x.com/flowersslop/status/1873115669568311727?t=eBMbK...