News for hackers. Stuff that matters.

A comment on My small, no name company has lost its mind with AI. Parent comment

Re:My small, no name company has lost its mind with AI by Volundr on Thursday July 06, 2023 @03:50PM (#36621812)
Huh? You won't update the model you'll just give it new information? The exact concern is that the new information will be garbage aimed at pushing the model to produce certain output. Much like SEO spammers do to manipulate Google search results.

"Just don't update the model, only feed it new information" is exactly how to get to the outcome of concern in this thread.

[ Parent | on HN ]
Re:My small, no name company has lost its mind with AI by janalsncm on Thursday July 06, 2023 @10:00PM (#36626048)
Yes, updating the model is different from updating the knowledge base the model uses.
[ Parent | on HN ]
Re:My small, no name company has lost its mind with AI by Volundr on Thursday July 06, 2023 @11:26PM (#36626719)
Great, so you've updated your knowledge base, it's got garbage targeted to make it attractive to the model, and now your model is outputting garbage. It's the exact same problem Google has fighting the SEO spammers. Now the model is significantly less useful, exactly as suggested.

We've already seen exactly this happened with search. There's no reason to believe that LLMs are immune.

[ Parent | on HN ]