News for hackers. Stuff that matters.
Re:Re-implementing LangChain in 100 lines of code by theturtletalks on Thursday May 04, 2023 @10:12PM (#35824525)
I completely agree with you on AI being extensively integrated into existing apps and being leveraged that way.

But most of the AI apps I see are just like a “skin” on ChatGPT API.

I do think there is value in a universal chat UI that can connect to GPT-3 and other models.

Re:Re-implementing LangChain in 100 lines of code by fbrncci on Thursday May 04, 2023 @10:40PM (#35824659)
I think that is a phase, which will come to pass, eventually most of the plugins and apps which are going to be popular, will likely run their own models or use open source models. Because the API calls for complex applications to OpenAI are currently far from economical. In the end you will have to charge the user, and that is going to be the crux. As a sole developer, doing loads of experiments on less than 50 documents, I am already crossing 50$ in API calls within a month. I can already run llama.cpp, but its just not good enough; but the cost would effectively be 0$ (not counting my hardware).