AI is making it easier to create more noise, when all I want is good search

Re:AI is making it easier to create more noise, when all I w... by mark_l_watson on Wednesday March 08, 2023 @12:10PM (#35071673)

The web demo version of ChatGPT can sometimes, as you say, make things up! I asked it a question about an ancient war in Greece and it stated two facts and then just inventing stuff.

However, I would ask you to also consider something: when you supply prompt input text (this is the "context text" in the ChatGPT API calls) and then ask questions about the context text, it is very accurate. It also does a very good job when you give it context text from a few different sources, and it integrates them nicely.

It is more efficient to use embeddings for context text, as Llama-Index does.

[ Parent | on HN ]

Re:AI is making it easier to create more noise, when all I w... by nico on Wednesday March 08, 2023 @02:17PM (#35073467)

Do you have shareable links to good tutorials about using embeddings with ChatGPT for this case?

[ Parent | on HN ]

Re:AI is making it easier to create more noise, when all I w... by mark_l_watson on Wednesday March 08, 2023 @07:57PM (#35076974)

I would start with https://gpt-index.readthedocs.io/en/latest/ and https://langchain.readthedocs.io/en/latest/

[ Parent | on HN ]

Re:AI is making it easier to create more noise, when all I w... by nico on Wednesday March 08, 2023 @09:43PM (#35077774)

Awesome, thank you!

[ Parent | on HN ]