Run and create custom ChatGPT-like bots with OpenChat

Re:Run and create custom ChatGPT-like bots with OpenChat by iamflimflam1 on Wednesday June 07, 2023 @09:50AM (#36226773)

There are a couple of things that can help. As has been pointed out by other commenters - chunking up content is very useful.

The other often neglected approach is to use an LLM to derive new content and use the embedding of this as well.

E.g. ask the LLM “give me a list of questions that can be answered by the following passage”

You then use embeddings of the generated questions instead of embeddings of the original content.

[ Parent | on HN ]

Re:Run and create custom ChatGPT-like bots with OpenChat by jerpint on Wednesday June 07, 2023 @09:58AM (#36226856)

another approach is HyDE, where you ask the LLM to come up with a plausible (but likely wrong) answer, and use the embedding of the wrong answer to find the appropriate chunk, pretty clever

[ Parent | on HN ]