News for hackers. Stuff that matters.
Re:Claude 4 by energy123 on Thursday May 22, 2025 @01:03PM (#44064092)

  > Finally, we've introduced thinking summaries for Claude 4 models that use a smaller model to condense lengthy thought processes. This summarization is only needed about 5% of the time—most thought processes are short enough to display in full.
This is not better for the user. No users want this. If you're doing this to prevent competitors training on your thought traces then fine. But if you really believe this is what users want, you need to reconsider.
Re:Claude 4 by comova on Thursday May 22, 2025 @01:07PM (#44064144)
I believe this is to improve performance by shortening the context window for long thinking processes. I don't think this is referring to real-time summarizing for the users' sake.
Re:Claude 4 by usaar333 on Thursday May 22, 2025 @01:53PM (#44064711)
When you do a chat are reasoning traces for prior model outputs in the LLM context?
Re:Claude 4 by int_19h on Thursday May 22, 2025 @04:21PM (#44066443)
No, they are normally stripped out.
Re:Claude 4 by j_maffe on Thursday May 22, 2025 @01:56PM (#44064751)
> I don't think this is referring to real-time summarizing for the users' sake.

That's exactly what it's referring to.

Re:Claude 4 by dr_kiszonka on Thursday May 22, 2025 @02:08PM (#44064895)
I agree. Thinking traces are the first thing I check when I suspect Claude lied to me. Call me cynical, but I suspect that these new summaries will conveniently remove the "evidence."
Re:Claude 4 by throwaway314155 on Thursday May 22, 2025 @01:05PM (#44064117)
If _you_ really believe this is what all users want, _you_ should reconsider. Your describing a feature for power users. It should be a toggle but it's silly to say it didn't improve UX for people who don't want to read strange babbling chains of thought.
Re:Claude 4 by energy123 on Thursday May 22, 2025 @01:19PM (#44064268)
You're accusing me of mind reading other users, but then proceed to engage in your own mind reading of those same users.

Have a look in Gemini related subreddits after they nerfed their CoT yesterday. There's nobody happy about this trend. A high quality CoT that gets put through a small LLM is really no better than noise. Paternalistic noise. It's not worth reading. Just don't even show me the CoT at all.

If someone is paying for Opus 4 then they likely are a power user, anyway. They're doing it for the frontier performance and I would assume such users would appreciate the real CoT.

Re:Claude 4 by porridgeraisin on Thursday May 22, 2025 @01:15PM (#44064226)
Here's an example non-power-user usecase for CoT:

Sometimes when I miss to specify a detail in my prompt and it's just a short task where I don't bother with long processes like "ask clarifying questions, make a plan and then follow it" etc etc, I see it talking about making that assumption in the CoT and I immediately cancel the request and edit the detail in.