News for hackers. Stuff that matters.
Re:Our next-generation model: Gemini 1.5 by ssd532 on Friday February 16, 2024 @02:15PM (#39401652)
Is it same as embedding? Is embedding an RAG method?
Re:Our next-generation model: Gemini 1.5 by scotty79 on Friday February 16, 2024 @08:28PM (#39405393)
I don't think so. I think embedding is just converting token string into its numeric representation. Numeric representations of semantically similar token strings are close geometrically.

RAG is training AI to be a guy who read a lot of books. He doesn't know all of them in the context of this conversation you are having with him, but he sort of remembers where he read about the thing you are talking about and he has a library behind him into which he can reach and cite what he read verbatim thus introducing it into the context of your conversation.

I might be wrong though. I'm a newb.