You’d think that with more context it would get better, but it doesn’t.

My hunches are that the to-and-fro of ideas as you discuss options or make corrections leads to a context with competing “intentions”; and that they can’t tell the difference between positive and negative experiences when it comes across each successive token in the context.

But I don’t make LMMs, so this is pure guesswork.