Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by bawolff on Saturday August 16, 2025 @03:20AM
(#44921037)
What does it mean for a model to find something "distressing"?
[ Parent
| on HN ]
Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by KoolKat23 on Saturday August 16, 2025 @06:01AM
(#44921874)
"Claude’s real-world expressions of apparent distress and happiness follow predictable patterns with clear causal factors. Analysis of real-world Claude interactions from early external testing revealed consistent triggers for expressions of apparent distress (primarily from persistent attempted boundary violations) and happiness (primarily associated with creative collaboration and philosophical exploration)."
Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by bawolff on Saturday August 16, 2025 @12:22PM
(#44924770)
That quote doesnt seem to appear in your link.
Regardless i meant more concretely.
Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by KoolKat23 on Saturday August 16, 2025 @02:13PM
(#44925700)
Sorry it may be from the paper linked on that page.
A strong preference against engaging with harmful tasks;
A pattern of apparent distress when engaging with real-world users seeking harmful content; and
A tendency to end harmful conversations when given the ability to do so in simulated user interactions.
I'm sure they'll have the definition in a paper somewhere, perhaps the same paper.