> No use of OpenAI technology to direct autonomous weapons systems
Not surprised to see a guy like Altman adopt the strategy
Mass surveillance doesn't require a warrant, that's why they want it, that's why it's "mass". warrants mean judicial overview. Anthropic didn't disagree with surveillance where a court (even a FISA court!!) issued a warrant. Trump just doesn't want to go through even a FISA court.
This is pure evil from Sam Altman.
Is anyone listing these peoples names somewhere for posterity's sake? I'd hate to think this would all be forgotten. From Altman to Zuckerberg, if justice prevails they'll be on the receiving end of retribution.
Consider this, the bill of rights stipulates that a soldier cannot be stationed on your property in times of peace, but in times of war it will be allowed. It makes exceptions for times of war. but even in times of war, 4th amendment's search and seizure protection don't have an exception. Even in times of insurrection and rebellion. To deliberately violate that for personal and political reasons, that in itself is treason. With that intent alone, even without action, it invalidates all legitimacy that government has. If a clause in a contract is broken, the contract is broken. The bill of rights is the contract between the people and their government that gives the government its powers to rule, in exchange for those rights. With the contract explicitly, deliberately and with provable malicious intent broken, the whole agreement is invalidated.
I'll even say this, the US military itself is on the hook if they stand by and let this happen.
The current US government has a fundamentally different ontology for the derivation of human rights.
Wheras you and I likely agree that human rights are inalienable due to them being derived from the universe nature of human experience, the administration believes that human rights begin and end with them, the state. When they're the one able to affect the world with violence, it doesn't matter who's on the hook. The US electorate thought they could heal a status wound by authoritarianism instead of therapy and everyone else is paying the price.
Wort case, the current admin will make nazis look like cosplayers, and within a decade or so, he'll be standing next other ceos facing a tribunal in front of whatever entity managed to topple the former regime, and it will be under warcrime terms that are yet to be defined and for atrocities, which if history teaches us anything, will be so horrific our current ability to imagine antrocities is insufficient to allows to speculate on their nature.
In short, whatever trump does with openai, Sam Altman is in the "whatever trump wants to do was lawful" camp. Even then, perhaps the next regime will fail to learn from history and focus on rebuilding, but if they do learn from history they'll understand that you really can't hold back when it comes to these things. We're in this mess because of failure to sufficiently punish the nazis and the confederates in the US, both of which lasted only for about half a decade by the way. it isn't enough to teach people how horrible nazis and confederates were, the German approach is sensible, but a more extreme approach might be required.
Funny thing is, this might just save openai from total collapse. But if this is the price to keeping the economy alive, even at my own personal cost I hope the economy collapses completely along with these companies and regime.
As much as a third reconstruction is desperately needed, my desire for its existence is not materially tied to it being rendered into the world.
That would most definitely not be the Constitutional recourse. Or a sensible approach. If that happens, the Constitution is past tense.
Congress and the Supreme Court are the recourse. If they don't hold up the Constitution then violence or even a non-violent military coup, however well intended, are not going to put the splattered egg back together again.
The last two and a half decades have seen all four presidents, congress, the Supreme Court and both parties allow blatantly unconstitutional surveillance become the norm (evolving an adaptive fig leaf of intermediaries), and presidential military actions entirely blur out the required Congressional oversight. That the weakening of loyalty to the Constitution has been pervasive on those serious counts, is one of the reasons it has been so easy to undermine further.
When governing bodies become familiar with the convenient practice of "deciding" what the constitution means, without repercussions, that lost respect becomes very hard to reinstate.
If the commander in cheif and the civilian administration are clearly and unquestionably violating the constitution, they are no longer legitimate. If they are acting to harm the american people, acting as agents of a foreign enemy or as a domestic enemy to harm the american people, then they are not only illegitimate but the military is oath-bound to fight them with necessary force.
> That the weakening of loyalty to the Constitution has been pervasive on those serious counts, is one of the reasons it has been so easy to undermine further.
I can agree with that, that is because the people who swore an oath to defend it have not done so. They wave flags like it's a sports team they're cheering for.
Ultimately, the design of the constitution is such that either the people taking arms, or a patriotic military resisting the government would serve as the ultimate recourse. The system of checks and balances works so long as consequences are still a thing. If in the 1800s a president decided to do half the things trump did, anyone could shoot his face off and get away with it without consequence. These things aren't practical anymore.
The military has the duty to resist unlawful orders. But if a russian agent usurped the US government and civilians are incapable of doing something about it, then that's what they're there for. The military doesn't exist to bomb foreign countries thousands of miles away, it is there to defend the homeland. The original idea was that if laws are no longer a thing (obeyed by the government) the lawlessness would be too terrifying for those in power, therefore lawfulness is in their interest.
I am not saying the military shouldn’t ever enact a coup for the good of the people.
But it would be to defend the people, and some hope of reinstating the constitution, by unconstitutional means.
Dark times.
The US government can update its laws and come back to Anthropic, or do what they just did
> The US government can update its laws and come back to Anthropic
No, this I do take issue with. It's the people who update the U.S. government's laws.
> but it may be able to do so in the future.
You don't obey laws in the future, you obey laws today. Companies have an obligation to follow the laws as written today. Not only that, as americans they and all americans have a patriotic and civic duty to resist attempts to bypass or undermine the constitution of their country. You literally can't be patriotic or loyal to your country without doing so, it is what constitutes the country.
It's not like Anthropic can't update their guardrails and contracts once the laws of the land are updated. They simply resisted a criminal and treasonous abuse of power.
This is just incoherent. You can't have US companies fix an unhinged US government.
If the government runs wild, there are some serious questions to be asked at a state level, about how that could happen, how to fix it quickly and how to prevent it in the future – but I should hope none of them concern themselves with the ideas of individual company owners, because if the government can de fact do what it wants regardless of legality the next thing that this government does could simply be pointing increasingly non-metaphorical guns at individual AI company functionaries.
Which part? No one expects them to fix the government, matter of fact they should stay far away from it. However, they have a duty to obey the law and to be patriotic. All companies must resist attempts by the government to betray its people, because the government derives its authority from the people, therefore in its betrayal it has become an illegitimate enemy of the people instead of their legitimate government.
> because if the government can de fact do what it wants regardless of legality the next thing that this government does could simply be pointing increasingly non-metaphorical guns at individual AI company functionaries.
It feels like you and half the country never even at least watched movies surrounding nazi germany. The government can do whatever it wants, but whether it is companies, individuals working for it, or soldiers under orders, the government's authority does not excuse their participation. The government can't do anything at all on its own, it needs people to do it. If Obama wanted to get Anthropic to let their models aid al-qaeda with attacking America, should Anthropic say "oh well, since you're the government, go ahead?" This is the same thing. Ever heard of the phrase "enemies foreign or domestic" in the swearing of oaths? Company executives are beholden to the laws of the country they operate in. I mean, with Nazis at least their orders, and the orders of companies under their regime was lawful, even then it was not an excuse but they just changed the laws to make their orders lawful. Right now, we have laws and the government is breaking it, even "i followed lawful orders" isn't an excuse. Sam Altman is complicit in the violation of the American constitution and the betrayal of its people.
If all else fails, I expect the government to just train their own models. In which case, I'd say the engineers working in that effort should have resisted.
As I said in a sibling comment, mass surveillance cannot be considered legal in the US under any context. not even war, emergency, terrorism, nuclear strike, national security reasons, imminent danger to the public,etc.. targeted surveillance can, scoped surveillance of a group of people can, but not mass surveillance. In other words Sam Altman is saying "This thing can never be legal short of a constitutional amendment, but so long as trump says it is, we'll look the other way".
What a two-faced <things i can't say on HN> this guy is!
I really hope Google poaches all his top engineers. If any of you are reading this, I ask you this, I get working for money, but will Google or Anthropic offer you all that much less? Consider the difference in pay when you put a price on your conscious.
I don't expect companies to be moral, but I do expect them to be patriotic, and to obey the law. And I also expect the government to punish them sufficiently when they fail to do so. The morality part is for the people to legislate or some other way enact laws to reflect their beliefs. Companies don't get a vote at the ballot box and they certainly are not agents for moral arbitrage between a government and its people.
Excuse me, but what a fucked up perspective. "Impose its own morals into the use of its products"? What happened to "We give each other the freedom to hold beliefs and act accordingly unless it does harm"? How on earth did it come to something where the framing is that anyone is "imposing" anything on another simply by not providing services or a product that fits somebody else's need? That sounds like you're buying into the reversed victim and offender narrative.
And this is not about whether one agrees with their beliefs. It is about giving others the right to have their own.
But, as I've said, I tend to agree with both Anthropic and the Administration's positions. What was wrong here is that rather than just terminating the contract, the Administration went nuclear.
"Impose" makes it sound like Anthropic is being hostile here. And also, I don't think this is a situation that calls for moral relativism.
Anthropic is not asking for their product to be used in line with their ethics, they are basically demanding it. I don’t necessarily think they are wrong but I don’t think we need to sugarcoat it either. It’s a demand and if it differs from what the DoW wants to use the tech for…of course its going to be in conflict. “Impose” is appropriate.
> Per DoD Directive 3000.09 (dtd 25 January 2023), any use of AI in autonomous and semi-autonomous systems must undergo rigorous verification, validation, and testing to ensure they perform as intended in realistic environments before deployment. The emphasized language is the delta between what OpenAI agreed and what Anthropic wanted.
> OpenAI acceded to demands that the US Government can do whatever it wants that is legal. Anthropic wanted to impose its own morals into the use of its products.
So first off, regarding that first paragraph, didn't any of these idiots watch WarGames, or heck, Terminator? This is not just "oh, why are you quoting Hollywood hyperbole" - a hallmark of today's AI is we can't really control it except for some "pretty please we really really mean it be nice" in the system prompt, and even experts in the field have shown how that can fail miserably: https://www.tomshardware.com/tech-industry/artificial-intell...
Second, yes, I am relieved Anthropic wanted to "impose" their morals because, if anything, the current administration has been loud and clear that the law basically means whatever they says it does and will absolutely push it to absurd limits, so I now value "legal limits" as absolutely meaningless - what is needed are hard, non-bullshit statements about red lines, and Anthropic stood by the those, and Altman showed what a weasel he is and acceded to their demands.
>How on earth did it come to something where the framing is that anyone is "imposing" anything on another simply by not providing services or a product that fits somebody else's need?
The department of defense in particular has a law on the books allowing them to force a company to sell them something. They generally are more than willing to pay a pretty penny for something so it hardly needs used, but I'd be shocked if any country with a serious military didn't have similar laws.
So your right when it comes to private citizens, but the DoD literally has a special carve out on the books.
A lawsuit challenging it would have actually been insane from anthropic because they would have had to argue "we're not that special you can just use someone else" in court.
A more clear example would be, what would you expect to happen if Intel and amd said our chips can't be used in computers that are used in war.
for many decades, the DoD has used a carrot to get what they want. this is a stick.
If Anthropic can survive on open source contributors shelling out $200/mo and private sector companies doing the same, the government wishes them well. But surely you agree the government has a right to determine how its budget is appropriated?
This is obviously subjective, and the only subject that matters in this case is the leadership at the DoD.
> We have no choice but to pay taxes and make the federal government 20 percent of our economy. There is no single company or any other entity that is close. And extending it to everyone who has a government contract probably makes it the majority of the economy.
I, too, hate big government and the all-powerful executive branch. Welcome to my tent. Let’s invent a time machine together so we can elect Ron Paul in 2008 and nip this in the bud.
Until then, this is what we’re stuck with.
I think the government doesn't have rights, it is my elected representative. And I do not agree with it trying to punish a company for not agreeing to contract terms.
This is key because it's the textbook example of a war crime. It's also something that the current administration has bragged doing dozens of times.
More succinctly: who decides what is legal here? OpenAI, the Secretary of Defense, or a judge?
> More succinctly: who decides what is legal here?
Why are people concentrating on legality? Look at the language | The Department of War may use the AI System for all lawful purposes, consistent with applicable law, operational requirements, and well-established safety and oversight protocols.
It's not just "legal". Their usage just needs to be consistent with one of - legal
- operational requirements
- "well-established safety and oversight protocols"
Operational requirements might just be a free pass to do whatever they want. The well established protocols seems like a distraction from the second condition. > who decides what is [consistent with operational requirements] here?
The Secretary of Defense. The same person who has directed people to do extrajudicial killings. Killings that would be war crimes even if those people were enemy combatants.There's also subtle language elsewhere. Notice the word "domestic" shows up between "mass" and "surveillance"? We already have another agency that's exploited that one...
Why do you read that to mean just one is required?
It is a list of 4 items. This should not have been written like this to stand up nicely in courts and gives way to interpretation now.
The Department of War may use the AI System for all lawful purposes, consistent with
- applicable law
- operational requirements
- and well established safety and oversight protocols.
Whereas if I try to parse it as a list of 4 items, it's not grammatical:
The Department of War may use the AI System
- for all lawful purposes
- consistent with applicable law
- operational requirements
- and well-established safety and oversight protocols.
I can see the logic if we were talking about dumb weapons--the old debate about guns don't kill people, people kill people. Except now we are in fact talking about guns that kill people.
> More succinctly: who decides what is legal here? OpenAI, the Secretary of Defense, or a judge?
Yeah, there's a pretty strong case that anyone claiming to trust that the administration cares about operating in good faith with respect to the law is either delusional or lying.
The other says you may build the Terminator if the DOD lawyers say it’s okay.
This is a major distinction.
Secondly, as that is department policy and not a law or regulation, they appear to be saying that the cited directive is presently the only thing standing between the DOD and the use of autonomous weapons.
If that’s the case how hard is it to change or alter a directive?
We have been sharing technology and weapons with Israel while it prosecutes a genocide in contravention of both US and International law.
We are currently prosecuting a war on Iran that is illegal under both US and International law.
Any aid given to such a force is to underwrite that lawlessness and it shows a reckless disregard for the very notion of a 'nation of laws'.
When OpenAI says, 'The Military can do what is legal', full in the knowledge that this military has no interest in even pretextual legality, one has to wonder why you hold that you 'agree with' both of these decisions.
Do you believe the flimsiest of lies in other aspects of your life?
What if Anthropic's morals are "we won't sell someone a product for something that it's not realistically capable of doing with a high degree of success? The government can't do what something if it's literally impossible (e.g. "safe" backdoors in encryption), but it's legal for them to attempt even when failure is predetermined. We don't know that's what's going on here, but you haven't provided any evidence that's sufficient to differentiate between those scenarios, so it's fairly misleading to phrase it as fact rather than conjecture.
I don't understand any interpretation of this whole saga that claims that Anthropic was acting selfishly here. I could at least understand (but would vehemently disagree with) a claim that it's bad for them not to be trying to sell something that they genuinely did not think was safe for the task it was being purchased for, but the idea that they're somehow "imposing" morals on the others is nonsensical to me. If anything, I'd expect that trying to sell a complex software system for a purpose it's unfit for might even receive scrutiny for potential fraud in a more healthy regulatory environment.
I guess you can consider it a moral stance that if the government constantly does illegal things you wouldn't trust them to follow the law.
I know that's not what Anthropic said but that's the gist I'm getting.
If my read is correct: I personally agree with the DoD that Anthropic's demands were not something any military should agree to. However, as you say, the DoD's reaction to Anthropic's terms is wildly inappropriate and materially harmed our military by forcing all private companies to re-evaluate whether selling to the military is a good idea going forward.
The DoD likely spends somewhere on the order of ~$100M/year with Google; but Google owns a 14% stake in Anthropic, who spends at least that much if not more on training and inference. All-in-all, that relationship is worth on the order of ~$10B+. If Google is put into the position of having to decide between servicing DoD contracts or maintaining Anthropic as an investee and customer, its not trivially obvious that they'd pick the DoD unless forced to with behind-the-scenes threats and the DPA. Amazon is in a similar situation; its only Microsoft that has contracts large enough with the DoD where their decision is obvious. Hegseth's decision leaves the DoD, our military, and our defense materially weaker by both refusing federal access to state of the art technology, and creating a schism in the broader tech ecosystem where many players will now refuse to engage with the government.
Either party could have walked away from negotiations if they were unhappy with the terms. Alternatively: the DoD should have agreed to Anthropic's red lines, then constrained/compartmentalized their usage of Anthropic's technology to a clearly limited and non-combat capacity until re-negotiation and expansion of the deal could happen. Instead, we get where we're at, which is not good.
IMO: I know a lot of people are scared of a fascist-like future for the US, but personally I'm more fearful of a different outcome. Our government and military has lost all of its capacity to manufacture and innovate. Its been conceded to private industry, and its at the point where private industry has grown so large that companies can seriously say "ok, we won't work with you, bye" and it just be, like, fine for their bottom line. The US cannot grow federal spending and cannot find a reasonable path to taxing or otherwise slowing down the rise of private industry. We're not headed into fascism (though there are elements of that in the current admin): We're headed into Snow Crash. The military is just a thin coordination layer of operators piecing together technology from OpenAI, Boeing, Anduril, Raytheon. Public governments everywhere are being out-competed by private industry, and in some countries it feels like industry tolerates the government, because it still has some decreasing semblance of authority, but especially in the US that semblance of authority has been on a downward trend for years. Google's revenue was 7% of the US Federal Government's revenue last year. That's fucking insane. What happens when we get to the point where Federal debt becomes unserviceable? When Google or Apple or Microsoft hit 10%, or 15%? Our government loses its ability to actually function effectively; and private industry will be there to fill the void.
It begins “The Department of War may use the AI System for all lawful purposes…” and at no point does it limit that. Rather, it describes what the DOW considers lawful today, and allows them to change the regulations.
As Dario said, it’s weasel legal language, and this administration is the master of taking liberties with legalese, like killing civilians on boats, sending troops to cities, seizing state ballots, deporting immigrants for speech, etc etc etc.
Sam Altman is either a fool, or he thinks the rest of us are.
This is an objective standard as a matter of contract interpretation. If it was the government’s right to determine the lawfulness of a usage, it would say so. Perhaps it does elsewhere in the agreement, but that’s not the case here.
OpenAI is passing off their deal as providing additional safeguards beyond “all legal uses” but the language they’ve released doesn’t seem to support that narrative. I’m incensed, and am attempting to point out the hypocrisy in the hopes that OAI gets some blowback for this cynical stunt.
> OpenAI acceded to demands that the US Government can do whatever it wants that is legal.
FTFY. The administration threw a fit and tried to retroactively demote a retired military officer for making a video saying, "Troops, you should disobey unlawful orders". Over 4000 times has been told, "No, that's not what the law regarding detaining undocumented aliens means", and continues doing it. Their first response to the Supreme Court saying, "the President can't impose tarriffs" was "The Hell I can't!".
It's 100% clear that Trump thinks "what the law allows" and "what I want to do" are the same thing.
Rule of law requires that the majority of people in the system are committed to the rule of law, and refuse to go along with violations of it. Anthropic is being a good citizen here; OpenAI is not.
The emphasized language is the delta between what OpenAI agreed and what Anthropic wanted.
OpenAI acceded to demands that the US Government can do whatever it wants that is legal. Anthropic wanted to impose its own morals into the use of its products.
I personally can agree with both, and I do believe that the Administration's behavior towards Anthropic was abhorrant, bad-faith and ultimately damaging to US interests.