At some point I think these sorts of analogies break down, as the setup becomes too foreign to what we're more concretely used to.
In this case: there is no pen or paper which can store what you write on a replicated set of servers across the world, with an accompanying ToS telling you how that will be treated/used.
Although I have little sympathy for this women (both her intent and stupidity), I do agree this is a dangerous thing.
If we assume that "may" here means "could somehow" and not "is authorized to", the legal action after revelation seems correct on a technicality (ignoring whether the person viewing it has any relation to the person being threatened). The question is only whether Anthropic should or should not report it.
> "It was clearly intended to be a private note!"
A threatening note to whom? Yourself? Sure, sure. Maybe don't write down the ones that say "Note to self: murder my neighbor".
Selling analogous profiles of companies using their services to the highest bidder would be another idea.
Whether intentionally or not, they market their product as suitable for all kinds of things that it clearly isn't when input is being used that way.
I think Anthropic did the right thing to report it due to valid safety concerns. And if they had found credible plans for her to attack I think she can be charged with attempt. But just using AI as a diary I think the prosecutor's office is reaching beyond what the law allows but unfortunately I think there is a possibility that she may be convicted.
Today I learned about "foldering"[1], which uses the drafts folder of email systems as a "dead drop" between multiple participants. It goes back to at least 2005.
Back when I was in IT, circa 2010, I learned that several of the users of our systems routinely relied on the "deleted items" folder of Microsoft Outlook as a filing system, with multiple gigabytes important files stored there. 8(
Our customs are routinely ignored by everyone else.
Former head of the CIA, David Petreaus, was using the drafts folder of a shared Gmail account to communicate with his mistress.
Then these people didn't change their ways when they were given adequate space.
The Spy's Son: The True Story of the Highest-Ranking CIA Officer Ever Convicted of Espionage and the Son He Trained to Spy for Russia
LLMs seem to be moving toward personhood.
And after all the LLM learns from user posts too, and if everybody starts posting their darkest desires, fantasies, plans it may skew the "alignment" to say the least. Lets hope that the AGI level doesn't necessarily come with cheating, lying, religious fervor, power lust or whatever other sideeffects have been observed in human intelligence.
https://icap.law.georgetown.edu/wp-content/uploads/2026/02/T...
I am not a lawyer, but I find it hard to believe this statement meets that bar.
I don't know why people are even discussing this case like these companies will do anything on behalf of a consumer or think ethically at all.
Bots mass read and file and report all prompts that get categorized a certain way. They store everything else regardless. This will never change. It will only be exploited more and more. That's how this type of technology is deployed and progresses. Look at any other parallel. Like cameras or microphones.
I don't think it's worth dedicating even 2% of someone's day to avoiding surveillance. But I do think it's sad how many people don't realize all the utility they are gaining is lost once surveilled. There are ways around majorly bad surveillance activities that don't cost much money or time. The 80-20 is completely worth it.
Which it clearly wasn't, right? I mean, okay, in this case, the message did get reviewed by another person, but that's obviously an exceptional circumstance.
If I write something down on a piece of paper, and someone else goes through my garbage and finds it, is my note "communication made in a manner in which another person may view it"? It was clearly intended to be a private note!