News for hackers. Stuff that matters.
Re:LLMs Get Lost in Multi-Turn Conversation by jimmySixDOF on Thursday May 15, 2025 @09:08AM (#43994646)
>"conversations" are only a construct of product interfaces

This seems to be in flux now due to RL training on multiturn eval datasets so while the context window is evergreen every time, there will be some bias towards interpreting each prompt as part of a longer conversation. Mutliturn post training is not scaled out yet in public but I think it may be the way to keep on the 'double time spent on goal every 7 months curve'

There are no comments on this comment yet.