Anthropic's Safety Superpower

Re:Anthropic's Safety Superpower by cube2222 on Monday June 15, 2026 @07:07AM (#48539554)

Relatedly, I think it's worth noting that Anthropic models have consistently been top-scoring in BullshitBench[0], in a league of their own, really.

Not affiliated with the bench in any way, but I think it surfaces important differences between the behavior of the models from different labs.

TLDR: The benchmark is measuring pushback in response to nonsensical requests and questions, as opposed to going with it and hallucinating a nonsensical answer.

[0]: https://petergpt.github.io/bullshit-benchmark/viewer/index.v...

[ Parent | on HN ]

Re:Anthropic's Safety Superpower by mcintyre1994 on Monday June 15, 2026 @07:38AM (#48539836)

TBH this is the main thing that made me start trusting Claude enough to actually find it useful, and I'm surprised other models haven't caught up. I assumed they had and I just wasn't aware because I'm not using them in the same way.

[ Parent | on HN ]

Re:Anthropic's Safety Superpower by Supermancho on Monday June 15, 2026 @09:55AM (#48541344)

> I found my interactions with Fable to be extremely impressive; it made other models, including GPT 5.5 and Opus 4.8, feel small and dumb.

> Anthropic models have consistently been top-scoring in BullshitBench[0]

eyeroll I find that Anthropic models feel big and dumber.

https://www.endorlabs.com/research/ai-code-security-benchmar... puts Fable 5th, which seems about right to me.

I'm interested in code utility and correctness, even if the majority of AI use is not focused on that.

[ Parent | on HN ]

Re:Anthropic's Safety Superpower by airstrike on Monday June 15, 2026 @11:57AM (#48543185)

I think this just proves anyone can pick a benchmark that supports their point so maybe we shouldn't use treat them as evidence at all.

[ Parent | on HN ]