Re:LLMs Get Lost in Multi-Turn Conversation
by CompoundEyes on Wednesday May 14, 2025 @11:55PM
(#43991691)
Agreed poisoned is a good term. I’d like to see “version control” for conversations via the API and UI that lets you rollback to a previous place or clone from that spot into a new conversation. Even a typo or having to clarify a previous message skews the probabilities of future responses due to the accident.
[ Parent
| on HN ]
"Forking" or "branching" (probably better received outside of SWEs) a conversation really ought to be a first class feature of ChatGPT et Al.
Re:LLMs Get Lost in Multi-Turn Conversation
by HaZeust on Wednesday May 14, 2025 @11:59PM
(#43991719)
It is in Google Gemini, which I really hate to say - but I've been using a lot more than GPT. I reckon I'll be cancelling my Pro if Gemini stays with this lead for my everyday workflows.
Re:LLMs Get Lost in Multi-Turn Conversation
by energy123 on Thursday May 15, 2025 @12:18AM
(#43991799)
How? I use the Gemini web app and don't see it.
Re:LLMs Get Lost in Multi-Turn Conversation
by crooked-v on Thursday May 15, 2025 @12:59AM
(#43991987)
AI Studio is borderline unusable for long conversations. I don't know what in the world it's doing but it sure looks like a catastrophic memory leak in the basic design.
Re:LLMs Get Lost in Multi-Turn Conversation
by voidspark on Thursday May 15, 2025 @01:00AM
(#43991990)
I have been using it up to 100k tokens so far without issues. Never needed to go further than that. But much of that was in uploaded documents.
Re:LLMs Get Lost in Multi-Turn Conversation
by drittich on Thursday May 15, 2025 @01:02AM
(#43991999)
Also exists in LM Studio.
Re:LLMs Get Lost in Multi-Turn Conversation
by gdudeman on Thursday May 15, 2025 @01:30AM
(#43992137)
It is!
It exists in Claude as a true branch - you can see the old threads - and in ChatGPT as without the history.
Edit a previous reply and hit “go” to see it in action.
This has been in ChatGPT from pretty early on? Just edit any prompt, it creates a new branch, and you can switch back and forth.
Blimey, I didn't realise the entire thread was saved when you edited a prompt. Very good! Mind you, it feels "unsafe". I'd like to be able to clone a thread.
Re:LLMs Get Lost in Multi-Turn Conversation
by cruffle_duffle on Thursday May 15, 2025 @09:21PM
(#44000979)
You can toggle between different branches in both GPT and Claude.
Re:LLMs Get Lost in Multi-Turn Conversation
by wunderwuzzi23 on Thursday May 15, 2025 @02:39AM
(#43992429)
This was part of ChatGPT from pretty much the beginning, maybe not the initial version but few weeks later- don't recall exactly