News for hackers. Stuff that matters.
Re:Memory and new controls for ChatGPT by drcode on Tuesday February 13, 2024 @01:51PM (#39361248)
This kind of just sounds like junk that will clog up the context window

I'll have try it out though to know for sure

Re:Memory and new controls for ChatGPT by hobofan on Tuesday February 13, 2024 @02:02PM (#39361370)
I'm assuming that they have implemented it via a MemGPT-like approach, which doesn't clog the context window. The main pre-requisite for doing that is having good function calling, where OpenAI currently is significantly in the lead.
Re:Memory and new controls for ChatGPT by Prosammer on Tuesday February 13, 2024 @01:54PM (#39361274)
I've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to find the stuff I want from the text long before I hit the context window limit.
Re:Memory and new controls for ChatGPT by drcode on Tuesday February 13, 2024 @01:58PM (#39361319)
Yeah, there is basically a soft limit now where it just is less effective as the context gets larger