News for hackers. Stuff that matters.

Ask HN: How do you avoid / get out of LLMs local minima?

When using LLMs, I have the impression that they often stick to an idea which they dont seem to be able to shake off, no matter how much arguing I can put in, and however strongly I feel about it.

What's your trick to get the LLM out of its own beliefs ?

I often find myself having to kill the entire context, which is obviously not the best...

( 3 comments | on HN )
Re:Ask HN: How do you avoid / get out of LLMs local minima? by uberman on Saturday June 13, 2026 @04:39PM (#48521215)
I have found that in such situations all one needs to do is ask "are you sure x is y" atleast as far as most Claude models go. That usually results in and apology and and escape from your local min.
Re:Ask HN: How do you avoid / get out of LLMs local minima? by Jimmc414 on Saturday June 13, 2026 @11:16PM (#48523852)
This is conversational momentum due to the autoregressive nature of models. Each token is drawn from a probability distribution conditioned on the preceding tokens. The best method I know of working around this is to request and curate a markdown export package from a conversation that is used to prime a new conversation in a clean context.
Re:Ask HN: How do you avoid / get out of LLMs local minima? by skvark on Sunday June 14, 2026 @05:26AM (#48525581)
Having a separate planning / research phase helps with this. Make the LLM curate a plan by gathering internal and external context. Then execute the plan in another fresh session. Of course if the planning phase itself ends up in the local min then I would just start a new planning session with the learnings.