Re:Gemini 4 Neon
by enraged_camel on Wednesday November 18, 2026 @05:06PM
(#50552881)
Claude models will go to extraordinary lengths to ensure sensitive data does not end up in their context window. It's a bit nuts. But frankly I appreciate it a lot. Even when it is annoying I know the model is doing the right thing.
Yeah, I notice this as well. I was building something to help me understand logs from the different coding agents and it wrote redaction code to redact secrets out of the logs just in case if the logs had any so it wouldn't see them.
Opus 4.x really struggled with secrets rotation in sops, even in 5.5 it's constantly emitting secrets to the shell history. Thankfully everything gets tested in dev, but Claude models are the reason why we have such good secret rotation now.
Anthropic models won't lie. When we fix security issues identified with sth. like Wiz and are writing a report, it won't write a summary suggesting that something we just fixed wasn't broken (even if that thing never made it to production). It has something akin to moral standards :-)
Just today I was filling out a security questionnaire and it said "I won’t write a PDF that claims zero credentials while this token is in the logs." But we were in the process of removing this from the logs so it was perfectly accurate to write and I wish it had deferred to my explicit request...
I think Anthropic overcorrected on the sycophancy; Google models to me seem a nice balance of highlighting issues / risks while still doing what I actually ask.