News for hackers. Stuff that matters.

A comment on Show HN: CopilotKit- Build in-app AI chatbots and AI-powered Textareas.

Re:Show HN: CopilotKit- Build in-app AI chatbots and AI-powe... by AYoung010 on Wednesday December 06, 2023 @03:58PM (#38549371)
Grow your OpenAI bill exponentially with this one easy trick!

In all seriousness — looks nifty! Do you guys have any plans to bring suggestion latency down from what’s show in the demo?

[ Parent | on HN ]
Re:Show HN: CopilotKit- Build in-app AI chatbots and AI-powe... by swiftlyTyped on Thursday December 07, 2023 @02:49PM (#38560944)
Latency is actually very low as-is, with GPT-4-Turbo!

But other than that, yes, we do have plans - using real-time RAG. I carried out some research with incredibly promising results

https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-ac...

[ Parent | on HN ]