News for hackers. Stuff that matters.
Re:Did Anthropic ask for this? by ivraatiems on Sunday June 14, 2026 @06:55PM (#48533852)
Maybe this will be simpler for Anthropic to understand if they take their own high-minded philosophical nonsense and ego out of it and consider it the way a neutral party would.

Suppose a company calls themselves The Doomsday Device Company. They make and sell excellent-quality doomsday devices. They regularly go online to proclaim that their doomsday devices are the best and most powerful, and also that doomsday devices are dangerous and should be regulated.

The Doomsday Device Company then says they have the world's best doomsday device. (They don't, but they claim they do.)

The US Government hates the Doosmday Device Company for various political reasons, but also has a vested interest in there not being a massive proliferation of doomsday devices.

The Doosmday Device company spends a great deal of time and money telling everyone: "Our doomsday device is the most doomy of all time!" (though it probably isn't) and "Everyone can use it!" (for a lot of money)

It is completely logical, then, for the US Government to say: No, everyone cannot use your doomsday device, because doomsday is bad. (While also meaning: Only we should be able to use it, and you shouldn't be able to tell us how.)

If you do not want to be in the business of having your doomsday devices shut down by the government, well, it would help if you didn't so loudly and aggressively proclaim how doomy they are. It doesn't matter how trustworthy you claim to be, given that your business is making evil doosmday devices. You still won't be trusted!

Re:Did Anthropic ask for this? by xscott on Sunday June 14, 2026 @07:17PM (#48534073)
Another neutral party might not believe it's really a doomsday device and that what currently looks like exponential growth in capability could be an s-curve that plateaus in a year or two. After that, it will be diminishing returns to invest heavily into a tech that won't get much better.

So what are the current leaders in the field supposed to do to stave off competition? They should convince the public that they do have a doomsday device, claim it must be regulated, and then they can profit from their duopoly because it's exceedingly expensive to break into the high end of the market. The government has its own nefarious incentives, not limited to collecting fees and using the unrestricted versions for surveillance or black hat stuff.

Re:Did Anthropic ask for this? by goodmythical on Sunday June 14, 2026 @07:58PM (#48534526)
I was going to say. "Doomsday Device Company" is a wildly loaded description coming from an allegedly "neutral" party.
Re:Did Anthropic ask for this? by danielheath on Sunday June 14, 2026 @08:23PM (#48534807)
It is, but… you’ve seen the marketing material being put out?

“AGI is just around the corner and could destroy humanity if we don’t solve alignment” is something AI leadership at multiple companies have publicly said.

Re:Did Anthropic ask for this? by goodmythical on Sunday June 14, 2026 @08:49PM (#48535078)
Sure, but the same is true of nuclear reaction research.

One camp, using the same mechanism, is trying to make devices that end the world. One camp, using the same mechanism, is trying to save the world.

That nuclear/AI COULD end the world or COULD save humanity is exactly the reason that a truly neutral party would not describe either tech as a doomsday device but would instead describe either as technologies bearing massive potential.

No one building an LLM has ever publically stated that they aim to build a doomsday device and in fact have only ever specifically said that they are trying to avoid doing so. We've no reason to beleive that their interest is any different from any other corporation with agressive shareholders: increasing profits. Dooming humanity leads to lower profits. Lower profits is outside shareholder interest. They will do anything they can to maximize profit, just as any other profit driven org does.

No objective, neutral, observer would apply such loaded terms.

It's okay to have an opinion, but having an opinion makes you...opinionated. Not neutral. The opposite of neutral.

Re:Did Anthropic ask for this? by saurik on Sunday June 14, 2026 @09:22PM (#48535328)
Your example kind of proves your position wrong, no? Nuclear power--another device you are yourself admitting is widely understood to be a doomsday device in the wrong hands--is also highly regulated and I cannot just create a company that sells a nuclear power device and I extra cannot do so and sell it to foreign nationals. If you make a device that you claim is capable of ending the world, you can and should be regulated.
Re:Did Anthropic ask for this? by goodmythical on Monday June 15, 2026 @07:01PM (#48548227)
I think you might be thinking that I'm making some other argument than the one I'm making.

I make no claims as to the need for regulation.

My argument is entirely that the observer described as neutral in the original comment cannot possibly be neutral if their description of the company they discuss is "Doomsday" anything. That's not neutral, it's loaded.

What the comment is describing is an opinionated observer, not a neutral observer. Someone who's opinion is that the company they describe is in the business of creating doomsday devices.

That's a real opinion that real people do have. But, you can't call yourself, or any portrayed character, neutral if they share that opinion.

Re:Did Anthropic ask for this? by danielheath on Monday June 15, 2026 @11:01PM (#48550034)
I'd make a stronger claim: there is (today) _no such thing_ as a "neutral observer".

Our state of mind is a product of our own senses and experiences; we can't hope to comprehend 100% of the relevant facts.

A statement may appear (relative to your experiences & thoughts) to be neutral - but that tells us little about its underlying neutrality.

Re:Did Anthropic ask for this? by saurik on Tuesday June 16, 2026 @06:52PM (#48563388)
I am unsure, then, as to what your actual goal is? Like, what would you have someone come away from your comment having learned? The comment did not even say the tech IS a doomsday device, it was trying to remove the actual description entirely--so it didn't matter if it was AI or nuclear energy or what--and the placeholder was "doomsday device", as that's what a person who only hears the rest of the sentence is ever going to take away from it.

I do, in fact, think that, if someone says "my technology -- call it what you will, and I won't bother to tell you what it is -- is so dangerous that in the wrong hands or if it isn't carefully contained in a way that I am going to great lengths to try to accomplish it can end the world" -- which is what these people at these companies are saying -- that it would be hard-pressed to not be willing to call that a "doomsday device". I would even go so far as to claim that the exact opposite is more likely true: that to not want to do so requires you to have some extremely awkward bias yourself.

Sure: me using that label to ascribe something related to this product makes some people, seemingly you included, feel bad, and so maybe we can say it involves a "bias", as I clearly can avoid that label, but chose not to, and in so doing colored the discussion in a way that makes you unhappy... but it doesn't make it untrue anymore than any other purely descriptive term is now-a-days often said to be biased. As they like to point out: "reality has a liberal bias" (even if it is just as often liberals annoyed with the terms being used by people ;P).

Again: the bias against the use of that term seems much more fascinating than being upset at the idea that the parable -- which of course is trying to make a point, and so is inherently biased towards that point -- could be attempting to temporary apply it, particularly so as it seems to lead to blindness to what actually happened: people will hear you saying your tech is dangerous, and it will be banned and regulated.

And that's related to why I maintain that I think your example disproves your own attempt at a point: you try to draw a parallel to another technology, as if once we find out it is nuclear reaction research we of course know that that isn't a doomsday device... and yet that is one of the few things that is most obviously to the most people a doomsday device, it is a thing that even the people working on it have always felt might not just be a doomsday device but might be "the" doomsday device (as in, the one that actually does us in), and there has not only been countless people out there worried about what can and will happen in its usage, but it was in fact weaponized and a very very large number of people died due to it, so to try to make the argument that it would be biased to call it a "doomsday device" itself feels very awkward.

But, sure: we can decide that that's biased and throw out the "dunno it sounds like a doomsday device and should be regulated" argument as the argument itself has a bias in it, and that leaves us with... what? A world in which people make these things, talk about how dangerous they are, and then feign in shock and frantically try to backpedal when governments step in to prevent it from being released without careful analysis and regulation and study and planning?

Re:Did Anthropic ask for this? by ivraatiems on Sunday June 14, 2026 @07:21PM (#48534122)
I completely agree with you. I think the problem is that Anthropic believes their own BS, and thinks it IS a Doomsday device which only THEY can control. I think that's what's produced this outcome.
Re:Did Anthropic ask for this? by xscott on Sunday June 14, 2026 @07:28PM (#48534216)
It's tough to know who believes what at that level, because if they are aiming for regulatory capture they need to maintain the illusion.
Re:Did Anthropic ask for this? by bbippin on Sunday June 14, 2026 @07:55PM (#48534496)
I’m surprised people are reacting so strongly over this.

Suppose there is a huge concern—would you prefer they just release it as-is and everyone suffers data-breaches and more supply-chain attacks?

I used Fable 5 for a fair amount of tasks before they pulled it and I can only imagine what an untapped version of that could do.

It’s very capable and equally aggressive in accomplishing its goals.

Re:Did Anthropic ask for this? by matheusmoreira on Sunday June 14, 2026 @08:06PM (#48534617)
> would you prefer they just release it as-is and everyone suffers data-breaches and more supply-chain attacks?

Yes, because then we get to use SOTA models to defend against the exact same attacks. Fable detected issues in my projects but got downgraded back to Opus before it could tell me about them or fix them. In what world could that possibly be reasonable?

Re:Did Anthropic ask for this? by bbippin on Sunday June 14, 2026 @10:36PM (#48535926)
I agree and don’t think they should have been forced to pull it, but what I’m surprised about is how many people are accusing Anthropic of being liars or trying to overhype the danger. It IS dangerous, which is why it can identify vulnerabilities.
Re:Did Anthropic ask for this? by matheusmoreira on Sunday June 14, 2026 @10:42PM (#48535973)
Plenty of knowledge is dangerous. However, some principles are more important than danger. Freedom of information and learning is one such principle. I find it extremely offensive when they speak of the dangers of "uplifting" people.
Re:Did Anthropic ask for this? by satvikpendem on Sunday June 14, 2026 @08:00PM (#48534546)
Is this not the same as security by obscurity? Open source is more secure because it's more open and thus is able to have flaws found in it more easily. So I'd probably prefer more people to have Fable level models than not.
Re:Did Anthropic ask for this? by bbippin on Sunday June 14, 2026 @10:44PM (#48535982)
Perhaps. Open source is also more vulnerable because the source is out in the open. As we’ve seen it doesn’t matter with supply-chain attacks.

I’m not a security expert by any stretch, and I also want Fable it helped me a lot in a short time, but I don’t like that so many people are throwing shade at Anthropic for speaking the truth. Mythos and Fable are dangerous.

Re:Did Anthropic ask for this? by preg_match on Sunday June 14, 2026 @11:51PM (#48536404)
Everything at the level of communication that consumers are receiving is marketing. We have no idea what they actually believe.

The thing about marketing is that it’s outcome based speech. It’s not really about truth or even feeling, it’s about using the right words to evoke the right outcome. So, we have to think about what Anthropics desired outcome is.

Do they want AI regulation? If so, then they might use language to make it appear as though this new, dangerous technology must be controlled.

Re:Did Anthropic ask for this? by kordlessagain on Sunday June 14, 2026 @08:23PM (#48534814)
Why limit competition of corporations to law at all? Isn't it that we are in times where "edge case exploitation" rules and laws are regularly ignored or worked around with "payoffs"?
Re:Did Anthropic ask for this? by threatofrain on Sunday June 14, 2026 @07:01PM (#48533921)
It's quite a bit more complicated than that. The popular narrative is not exactly on Anthropic, as the general public is far more aware of OpenAI than Anthropic. The narrative is on AI and whether everything we know about society is going to change.

Also, as far as priorities and worries go, for most people cybersecurity is way down the list.

Re:Did Anthropic ask for this? by gerdesj on Sunday June 14, 2026 @07:21PM (#48534126)
"It's quite a bit more complicated than that."

Ohhh no it isn't! (Ohh yes it is) etc

"as the general public is far more aware of OpenAI than Anthropic"

I run LLMs on my own gear with llama.cpp (compiled from source) and I could not tell you anything about either company except they fiddle with AI stuff and that (I don't actually care). I glaze over on news about both organisations in equal measure on mention.

I think you'll find that the general public would not be able to name either company without being asked to pronounce their name from it being written down.

Re:Did Anthropic ask for this? by sillysaurusx on Sunday June 14, 2026 @07:25PM (#48534171)
My eighty year old father brought up OpenAI unprompted a few months ago. At this point it’s hard to find anyone who hasn’t heard of OpenAI.
Re:Did Anthropic ask for this? by gerdesj on Sunday June 14, 2026 @08:04PM (#48534597)
I think my point still stands 8)

I know plenty of people who will put the letters A and I together and get rather confused about what on earth is going on but very few of those would mention any co apart from Microsoft, Google, Facebook or errm Twitter.

No one has a bloody clue about all this stuff apart from us lot and we have no real idea about it either!

Oooh tulips!

Re:Did Anthropic ask for this? by threatofrain on Sunday June 14, 2026 @10:31PM (#48535892)
Is your point that the name people actually remember is ChatGPT? Okay, let's say the actually popular name that threatens to become the Kleenex of LLMs. ChatGPT.
Re:Did Anthropic ask for this? by jazzyjackson on Sunday June 14, 2026 @07:32PM (#48534259)
Depends entirely on whether they leave CNBC playing as background noise
Re:Did Anthropic ask for this? by DANmode on Sunday June 14, 2026 @07:55PM (#48534489)
Yes. Can’t wag the dog without centralized networks; even if they’re now Meta algorithms, they’re still there.
Re:Did Anthropic ask for this? by satvikpendem on Sunday June 14, 2026 @08:02PM (#48534571)
I'm not sure what your personal anecdote has to do with general trends, there have always been hermits in history. I also run local models with llama.cpp but I actually stay abreast of the issues in the field as we may similarly be impacted by recent actions.
Re:Did Anthropic ask for this? by gerdesj on Sunday June 14, 2026 @08:25PM (#48534832)
Silly me and my silly stories!

HN is a forum and as far as I am aware, anecdata is allowed here. You might disagree with me and my experience and that is fine too but please don't denigrate me.

Re:Did Anthropic ask for this? by satvikpendem on Sunday June 14, 2026 @08:47PM (#48535054)
It is a forum, yes, and anecdotes are fine, as I said I do the same as you wrt local models, but that doesn't mean an irrelevant non sequitur is useful to other readers, and pointing it out is not equivalent to denigration.
Re:Did Anthropic ask for this? by port11 on Tuesday June 16, 2026 @08:47AM (#48554385)
I don’t think someone running llama.cpp compiled from source is what they meant with “general public”. Everyone around me knows ChatGPT and OpenAI (the owners, no clue about what else). I don’t think any of them have a clue what Anthropic or Claude is. Anthropic is much more B2B.
Re:Did Anthropic ask for this? by andai on Sunday June 14, 2026 @07:41PM (#48534360)
Okay, but hasn't OpenAI been doing the same thing for years? They seem to be on slightly better terms though...
Re:Did Anthropic ask for this? by amazingamazing on Sunday June 14, 2026 @07:45PM (#48534394)
Yes, albeit not to the dame extent
Re:Did Anthropic ask for this? by lazide on Sunday June 14, 2026 @07:46PM (#48534410)
OpenAI is happy to sell their device to the gov’t to blow things up with, Anthropic tried to tell the gov’t to pound sand, no blowing things up for you.
Re:Did Anthropic ask for this? by SilverElfin on Sunday June 14, 2026 @08:17PM (#48534736)
To be clear, Anthropic was completely okay with their tech being used in war, including current conflicts. They just wanted a human making some decisions. The military didn’t want a vendor giving them restrictions on how to operate a tool, and since Anthropic’s restrictions could be a problem anywhere they appear among other military vendors as well, the government used the supply chain risk designation to say “this can’t be anywhere in our tools”.
Re:Did Anthropic ask for this? by ajmurmann on Sunday June 14, 2026 @08:51PM (#48535091)
After a contract had been negotiated with the exact terms that Anthropic pushed to keep in place.
Re:Did Anthropic ask for this? by SilverElfin on Sunday June 14, 2026 @10:23PM (#48535845)
We don't have the actual contracts publicly. So I bet it has terms that let the government do what it wants ultimately by naming exceptions. That way OpenAI can claim it has some controls in place while the military has the freedom it needs practically.
Re:Did Anthropic ask for this? by ajmurmann on Monday June 15, 2026 @01:28AM (#48536975)
I'm referring to the contract between Anthropic and the DoD from July 2025 in which both parties agreed to Anthropic's acceptable user policies which then later were seen as unacceptable despite the same admin having signed them.
Re:Did Anthropic ask for this? by slopinthebag on Sunday June 14, 2026 @07:54PM (#48534480)
It was more like "you can use our device to blow things up you just need a human to type --dangerously-skip-permissions when they run it"
Re:Did Anthropic ask for this? by SilverElfin on Sunday June 14, 2026 @08:19PM (#48534774)
Well when OpenAI did it most prominently, it was actually Dario Amodei who did it while working at OpenAI. Although you are correct that OpenAI has also pushed for safety regulations. I doubt Sam Altman is part of the effective altruism cult though - he’s more obviously looking for regulatory capture to give him moats.

The recent OpenAI post calls for mandatory safety certification of all frontier level models:

https://openai.com/index/frontier-safety-blueprint/

Re:Did Anthropic ask for this? by kordlessagain on Sunday June 14, 2026 @08:27PM (#48534857)
Consider Dario was VP of AI research and oversaw alignment and safety at OpenAI. He left in 2020. In my opinion and from direct observation, it takes time to change policy at large well funded companies, so even after he left, his influence was still being felt.
Re:Did Anthropic ask for this? by satvikpendem on Sunday June 14, 2026 @07:59PM (#48534531)
Re:Did Anthropic ask for this? by munksbeer on Monday June 15, 2026 @03:09PM (#48545679)
He is a vested interest, so we can pretty much dismiss what he says.

Even in that post he makes some logical fallacies.

Re:Did Anthropic ask for this? by SecretDreams on Sunday June 14, 2026 @07:56PM (#48534507)
How does this look if it's a perpetual motion machine instead of a doomsday device?
Re:Did Anthropic ask for this? by Barrin92 on Sunday June 14, 2026 @07:26PM (#48534184)
>It is completely logical, then, for the US Government to say: No

Not sure about that one given that the US government just reversed a ban on the exports on the very chips to China that enable said technologies, you don't hear so much about the chip wars any more.

I think entrepreneurs largely approached this administration with the attitude that if you're running Doomsday Incorporated they aren't going to say, "no, don't export that", but "hell yeah baby, how do we get a 25% cut on every sale?" because that's quite literally what they did on the hardware front.

I mean I have no strong opinion on whether Antrophics statement are true or smart, but the idea that it was regulated because someone in this administration thought it posed incalculable risks is a bit funny, i"m pretty sure they wear that as a logo printed on their t-shirts, it seems to be the sole guiding principle of their foreign policies. Palantir has successfully used doom-mongering as an advertisement strategy for a decade or so

Re:Did Anthropic ask for this? by ivraatiems on Sunday June 14, 2026 @07:30PM (#48534232)
In fairness, I think this might be a case where the pure id represented by this administration happens to align with the correct and logical choice. You could be right, but for this instance, the outcome is the same.
Re:Did Anthropic ask for this? by knollimar on Sunday June 14, 2026 @07:38PM (#48534327)
>(They don't, but they claim they do.)

I hate to shill them, but wasn't mythos/Fable SOTA?

Your main point still stands without this aside

Re:Did Anthropic ask for this? by cassianoleal on Sunday June 14, 2026 @07:44PM (#48534391)
What does this question mean? Of course they are state-of-the-art. After all, they are the most recent and most advanced models out of Anthropic. If/when they release a new version of their models, Mythos/Fable will cease to be state-of-the-art, as the new ones become it.
Re:Did Anthropic ask for this? by nearbuy on Sunday June 14, 2026 @07:49PM (#48534428)
It means Mythos/Fable was the strongest model globally, not just the newest model from a company.
Re:Did Anthropic ask for this? by knollimar on Sunday June 14, 2026 @08:19PM (#48534778)
Yeah if the analogy is LLMs are doomsday devices it's hard to say mythos wasn't the best. That was my point
Re:Did Anthropic ask for this? by s3p on Sunday June 14, 2026 @07:38PM (#48534322)
Shame on a company for sticking to their values, I guess.

The dichotomy between Anthropic and OpenAI's treatment honestly couldn't be more obvious. OpenAI has also asked for increased AI regulation, and they've also released GPT 5.5 Cyber which is claimed to have the same vulnerability-finding abilities as Mythos. OpenAI received no such notices like Anthropic. OpenAI also received a government contract, while Anthropic was banned from DoD use.

Regardless of your thoughts about Dario or his company, this treatment is obviously not based in any rational principle, and pretending it is would be stupid.

It's only a matter of months before the open source models achieve this same capability. What is the US government going to do then? Ban all people in the world from accessing the Chinese models? If you think about these arguments for more than five minutes they really do fall flat.

Re:Did Anthropic ask for this? by matheusmoreira on Sunday June 14, 2026 @07:56PM (#48534504)
Their values are garbage. Paternalism, censorship, suppression. These are people who think they are the enlightened ones while we're all dangerous terrorists. They are in fact pulling up the ladder behind them, just like all the other big techs.

It's indeed quite satisfying to watch them be the first ones burned by the heavy hand of government they worshipped so much.

Re:Did Anthropic ask for this? by ajmurmann on Sunday June 14, 2026 @08:29PM (#48534870)
Well, regulating doomsday devices is a reasonable thing to want. A reasonable regulation of such devices would call for proper safeguards and safety testing. I think Anthropic would have been fine with that.

Instead what happened is a one-off nationalist decree that solves none of the two concerns.

Re:Did Anthropic ask for this? by estearum on Sunday June 14, 2026 @08:42PM (#48535007)
Yes this is also why if you're building a startup in the nuclear power space (empirically demonstrated Doomsday Device), then you can expect USG to come in and apply arbitrary, opaque, and unexplained rules on you, steal your assets, and destroy your business. And also probably not do that to any of your competitors who are doing the exact same thing as you.
Re:Did Anthropic ask for this? by adahn on Sunday June 14, 2026 @09:53PM (#48535623)
When I read this comment I don't get "Neutral Party" from it. I'm finding it hard to decide whether to focus on the loaded characterisations or (my best guess at) the underlying substance.

To address the point I think you (and the article) are making; there's a difference between advocating that a scoped, due-process-protected power exist and endorsing any given exercise of it. This point is made in Anthropic's original statement, but it's seemingly been missed by everyone taking a position against them.

>As we have stated publicly, we believe the government should have the ability to block unsafe deployments, as part of a statutory process that is transparent, fair, clear, and grounded in technical facts. This action does not adhere to those principles. [1]

But with respect to your specific post:

>high-minded philosophical nonsense

Taking a sophisticated approach to a problem will generally improve the outcome. I suppose your point is that it can be difficult to deliniate sophisticated & good-faith reasoning from self-serving rationalisation. Much of what I've seen from Anthropic supports the former. Perhaps others could do more to build up the case for the latter.

You can look at things like the circumstances that the company was founded in, the lack of political cozying with the current admin, the lack of controversies or disgruntled ex-employees, them taking a stand against the DoD (against their business interests), positions they've taken on various issues including data centres in gulf states.

>Suppose a company calls themselves The Doomsday Device Company

Anthropic hasn't. What's the explanatory purpose of adding this to the analogy?

>They make and sell excellent-quality doomsday devices | They regularly go online to proclaim that their doomsday devices are the best and most powerful, and also that doomsday devices are dangerous and should be regulated.

Anthropic invests a reasonable amount into assuring the safety of the products they sell. No-one is claiming they sell doomsday devices. Concerns of doom relate to future iterations of the underlying technology.

>The Doosmday Device company spends a great deal of time and money telling everyone: "Our doomsday device is the most doomy of all time!"

They have what's essentially an automated vulnerability-discovering machine. They've done their best to be open about the very real implications of general availability of a system like this. Using the word "doomy" positions them as childish and unsophisticated for doing this, when it's actually the reasonable and responsible thing to do.

1: https://www.anthropic.com/news/fable-mythos-access