News for hackers. Stuff that matters.
Re:LLMs Get Lost in Multi-Turn Conversation by OtherShrezzing on Thursday May 15, 2025 @05:35AM (#43993319)
I find using tools like LMStudio, which lets you edit your chat history on the fly, really helps deal with this problem. The models you can host locally are much weaker, but they perform a little better than the really big models once you need to factor in these poisoning problems.

A nice middle-ground I'm finding is to ask Claude an initial conversation starter in its "thinking" mode, and then copy/paste that conversation into LMStudio and have a weaker model like Gemma pick-up from where Claude left off.

There are no comments on this comment yet.