News for hackers. Stuff that matters.
Re:Memory and new controls for ChatGPT by Prosammer on Tuesday February 13, 2024 @01:54PM (#39361274)
I've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to find the stuff I want from the text long before I hit the context window limit.
Re:Memory and new controls for ChatGPT by drcode on Tuesday February 13, 2024 @01:58PM (#39361319)
Yeah, there is basically a soft limit now where it just is less effective as the context gets larger