News for hackers. Stuff that matters.
Re:Publish fake stats, get cited in LLMs by hyperpape on Tuesday October 20, 2026 @10:35AM (#50167082)
Two things:

1. This is a 2022 era picture that LLMs just suck up what's on the Internet and regurgitate it. It hasn't been true for a long time.

2. There's almost no one who has a stronger incentive to distinguish LLM generated text from non-generated LLM text. Training classifiers is pretty manageable.

Re:Publish fake stats, get cited in LLMs by vatsachak on Tuesday October 20, 2026 @11:11AM (#50167607)
This is not true.

The other day for me Google search AI cited triggerbites which is a vibe data website.

The LLM unless explicitly prompted cannot distinguish the validity of a data source.

Re:Publish fake stats, get cited in LLMs by imzadi on Tuesday October 20, 2026 @11:43AM (#50168113)
The other day I asked Gemini to evaluate if a Reddit post was true. It told me it was definitely true because it had been verified by legitimate news agencies that had reported on the incident. These "legitimate" news agencies were an AI aggregator that just had a direct summary of the post with a disclaimer that it wasn't independently verified and a yahoo news "article" that was just the same AI summary. The AI summary included hallucinations that weren't even part of the original reddit post (like giving the OP a gender when no genders were mentioned).
Re:Publish fake stats, get cited in LLMs by jjulius on Tuesday October 20, 2026 @10:55AM (#50167381)
>1. This is a 2022 era picture that LLMs just suck up what's on the Internet and regurgitate it. It hasn't been true for a long time.

When I ask ChatGPT certain questions, it very clearly shows me the sources it's searching through in the form of favicons, and they're always the favicons of sites that are in the first 5-10 results for a Google search query that would fit what I've asked the LLM. It will then cite those websites as it's source, with a direct link to the page that also shows up in an equivalent Google search. It does that daily.

Re:Publish fake stats, get cited in LLMs by baliex on Tuesday October 20, 2026 @11:07AM (#50167551)
It's possible that the favicons it shows and the web pages that are actually retrieved are not the same
Re:Publish fake stats, get cited in LLMs by jdlshore on Tuesday October 20, 2026 @11:19AM (#50167737)
Why do you believe that? The favicons seem like they’re generated by the UI, not the LLM.

On the other hand, I recently asked ChatGPT for some information about a group of people, and the headshots it put with each summary were very clearly not the people it was describing. So hallucinations do still occur even on the latest models, it just seems unlikely that the favicons would be LLM-generated.

Re:Publish fake stats, get cited in LLMs by pixl97 on Tuesday October 20, 2026 @11:07AM (#50167559)
I think they are talking about training not run time search.
Re:Publish fake stats, get cited in LLMs by TZubiri on Tuesday October 20, 2026 @10:53AM (#50167347)
>1. This is a 2022 era picture that LLMs just suck up what's on the Internet and regurgitate it. It hasn't been true for a long time

if anything it’s more true now, AI chatbots rarely use raw LLM output, instead they have CoT and use search tool calls. and the speed at which webpages are crawled is in the matter of hours. I posted something here on hn, then searched for it on google 1 hr later and its AI answered with my comment

https://share.google/aimode/PkQUVfA68AlHGb7Yr

there’s several companies right now making a killing of organic placement on chatbots similar to the SEO rush of early google

> 2) There's almost no one who has a stronger incentive to distinguish LLM generated text from non-generated LLM text. Training classifiers is pretty manageable

i think it’s pretty naive to think that if LLM companies would develop LLM detection they would use it to skip training on that content.

instead, they use it to train their output to be less detectable.

LLM detection is not solvable because it is adversarial, an arms race

Re:Publish fake stats, get cited in LLMs by f311a on Tuesday October 20, 2026 @10:37AM (#50167121)
I'm not sure you get my point. Just ask ChatGPT, "What are the top 10 xxx," and see which sources it cites. Oftentimes, it's complete garbage with LLM tells.
Re:Publish fake stats, get cited in LLMs by hyperpape on Tuesday October 20, 2026 @10:52AM (#50167331)
I'm responding to

> They now train on their own content.

Re:Publish fake stats, get cited in LLMs by f311a on Tuesday October 20, 2026 @10:57AM (#50167397)
They train on conversations which pull data from web.
Re:Publish fake stats, get cited in LLMs by 10111001 on Tuesday October 20, 2026 @10:37AM (#50167114)
> 2. There's almost no one who has a stronger incentive to distinguish LLM generated text from non-generated LLM text.

There's a tension there: they want you to use AI for everything, and if they get what they want then new information will be embedded in LLM text.

> Training classifiers is pretty manageable.

Hopefully such things can be opened up, so the slop can be iterated on until it passes. It doesn't need to be perfect, just enough so more garbage gets through.

Re:Publish fake stats, get cited in LLMs by hyperpape on Tuesday October 20, 2026 @10:53AM (#50167349)
> There's a tension there: they want you to use AI for everything, and if they get what they want then new information will be embedded in LLM text.

In the long term, this is probably a real concern that they have to tackle. They'll have to move away from just classifying things as LLM generated or not, to attempting to judge the underlying quality, and that's not an easy problem.

Re:Publish fake stats, get cited in LLMs by tarballing on Tuesday October 20, 2026 @12:23PM (#50168782)
The article literally describes ChatGPT regurgitating something it sucked up on the Internet to this day.