News for hackers. Stuff that matters.

A comment on Creating AI assistant with GPT and Ruby and Redis using embeddings. Parent comment

Re:Creating AI assistant with GPT and Ruby and Redis using e... by fzliu on Wednesday April 26, 2023 @05:58PM (#35720582)
Even with an incredibly long context window (say, 1M tokens), attention still suffers from a problem with long-term dependencies. This is probably why OpenAI hasn't publicly released their 32k token length model just yet.
[ Parent | on HN ]
Re:Creating AI assistant with GPT and Ruby and Redis using e... by Der_Einzige on Wednesday April 26, 2023 @06:18PM (#35720764)
I think they haven't released it because the capabilities it has are simply too powerful when combined with a vectorDB.
[ Parent | on HN ]
Re:Creating AI assistant with GPT and Ruby and Redis using e... by sparker72678 on Wednesday April 26, 2023 @06:21PM (#35720791)
Maybe. It's also probably staggeringly expensive to run.
[ Parent | on HN ]
Re:Creating AI assistant with GPT and Ruby and Redis using e... by nullsense on Wednesday April 26, 2023 @06:29PM (#35720867)
Probably all of the above
[ Parent | on HN ]
Re:Creating AI assistant with GPT and Ruby and Redis using e... by ChatGTP on Thursday April 27, 2023 @06:45AM (#35726088)
Curious what you mean by “too powerful”?
[ Parent | on HN ]