News for hackers. Stuff that matters.
Re:AI is becoming 'yes-men on servers' by berkes on Monday March 10, 2025 @12:38PM (#43322347)
My simple RAG setup has a steps that will return "We don't have this information" if e.g. our vector DB returns entries with far too low relevancy scores or if the response from the LLM fails to add certain attributes in its answer and so on.

Edit: TBC: these "steps" aren't LLMS or other models. They're simple code with simple if/elses and an accidental regex.

Again: an LLM/NN indeed has no "understanding" of what it creates. Especially the LLMs that are "just" statistical models. But the tooling around it, the entire chain can very well handle this.

Re:AI is becoming 'yes-men on servers' by robwwilliams on Monday March 10, 2025 @10:37PM (#43328618)
Perfect. We need that society of modules.