News for hackers. Stuff that matters.
Re:Show HN: I made an app to use local AI as daily driver by Grimblewald on Wednesday February 28, 2024 @10:15PM (#39546082)
You're misunderstanding. Imagine your query is matched against chunks of text from the database, where the relevance of information is evaluated for the window each time it slides. Then collecting the n most relevant chunks, these are included in the prompt so then the llm can provide answers from source documents verbatim. This is useful for cases where precise and exact answers are needed. For example, searching the docs for some package for the right api to call. You don't mant a name that's close to right it has to be correct to the character.

There are no comments on this comment yet.