News for hackers. Stuff that matters.
Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @06:14PM (#42940589)
Good, this idea that all weapons are evil is an insane luxury belief.
Re:Google removes pledge to not use AI for weapons from website by siltcakes on Tuesday February 04, 2025 @07:46PM (#42941755)
Do you see nothing wrong with the same company that makes YouTube Kids making killer AI? I think creating weapons is often evil. I think companies that have consumer brands should never make weapons, at the very least it's white washing what's really going on. At worst, they can leverage their media properties for propaganda purposes, spy on your Gmail and Maps usage and act as a vector for the most nefarious cyber terrorism imaginable.
Re:Google removes pledge to not use AI for weapons from website by greenavocado on Tuesday February 04, 2025 @08:10PM (#42942013)
The same company that brings you cute cartoons for kids might also develop technologies with military applications, but that doesn't make them inherently "evil." It just makes them a microcosm of humanity's duality: the same species that created the Mona Lisa also invented napalm.

Should companies with consumer brands never make weapons? Sure, and while we're at it, let's ban knives because they can be used for both chopping vegetables and stabbing people. The issue isn't the technology itself. It's how it's regulated, controlled, and used. And as for cyber terrorism? That's a problem with bad actors, not with the tools themselves.

So, by all means, keep pointing out the hypocrisy of a company that makes YouTube Kids and killer AI. Just don't pretend like you're not benefiting from the same duality every time you use a smartphone or the internet which don't forget is a technology born, ironically, from military research.

Re:Google removes pledge to not use AI for weapons from website by jcgrillo on Tuesday February 04, 2025 @08:14PM (#42942068)
It sounds like they're distracted, tbh. It's hard to imagine how a company that specializes in getting children addicted to unboxing videos can possibly be good at killing people.. oh, wait, maybe not after all..
Re:Google removes pledge to not use AI for weapons from website by ckrapu on Tuesday February 04, 2025 @06:18PM (#42940656)
There is a wide range of moral and practical opinions between the statement “all weapons are evil” and “global corporations ought not to develop autonomous weapons”.
Re:Google removes pledge to not use AI for weapons from website by cortesoft on Tuesday February 04, 2025 @06:55PM (#42941137)
Who should develop autonomous weapons?
Re:Google removes pledge to not use AI for weapons from website by IIAOPSW on Tuesday February 04, 2025 @07:08PM (#42941302)
Who should develop biological weapons? Chemical weapons? Nuclear weapons?

Ideally no one, and if the cost / expertise is so niche that only a handful of sophisticated actors could possibly actually do it, then in fact (by way of enforceable treaty) no one.

Re:Google removes pledge to not use AI for weapons from website by cakealert on Tuesday February 04, 2025 @07:29PM (#42941549)
> Who should develop biological weapons? Chemical weapons? Nuclear weapons?

Anyone who wants to establish deterrence against superiors or peers, and open up options for handling weaker opponents.

> enforceable treaty

Such a thing does not exist. International affairs are and will always be in a state of anarchy. If at some point they aren't, then there is no "international" anymore.

Re:Google removes pledge to not use AI for weapons from website by aydyn on Tuesday February 04, 2025 @07:29PM (#42941546)
So in other words, cede military superiority to your enemies? Come on you already know the rational solution to prisoner's dilemma, MAD, etc.

> enforceable treaty

How would you enforce it after you get nuked?

Re:Google removes pledge to not use AI for weapons from website by lmm on Tuesday February 04, 2025 @07:38PM (#42941650)
> in other words, cede military superiority to your enemies?

We're talking about making war slightly more expensive for yourself to preserve the things that matter, which is a trade-off that we make all the time. Even in war you don't have to race for the bottom for every marginal fraction-of-a-percent edge. We've managed to e.g. ban antipersonnel landmines, this is an extremely similar case.

> How would you enforce it after you get nuked?

And yet we've somehow managed to avoid getting into nuclear wars.

Re:Google removes pledge to not use AI for weapons from website by pixl97 on Tuesday February 04, 2025 @07:43PM (#42941717)
Because after proliferation the cost would be too great and nukes other than wiping cities aren't that useful

AI on the other hand seems to be very multi purpose

Re:Google removes pledge to not use AI for weapons from website by Sabinus on Tuesday February 04, 2025 @10:30PM (#42943347)
Resusal to make or use AI-enabled weapons is not "making war slightly expensive for yourself", it's like giving up on the Manhattan project because the product is dangerous.

Feels good but will lead to disaster in the long run.

Re:Google removes pledge to not use AI for weapons from website by aydyn on Wednesday February 05, 2025 @03:50AM (#42945807)
> And yet we've somehow managed to avoid getting into nuclear wars.

Yes, through a massive programme of nuclear armament. In the case of AI, we should therefore...?

Re:Google removes pledge to not use AI for weapons from website by kelsey98765431 on Wednesday February 05, 2025 @08:02AM (#42947911)
If we hadn't developed nuclear weapons we would still be burning coal and probably even closer to death from global warming. The answer here is government contractors should be developing the various type of weapon as they are, people just do not think of google as a government contractor for some reason.
Re:Google removes pledge to not use AI for weapons from website by vasco on Tuesday February 04, 2025 @06:28PM (#42940795)
Palantir exists, this would just be competition. It's not like Google is the only company capable of creating autonomous weapons so if they abstain the world is saved. They just want a piece of the pie. The problem is the pie comes with dead babies, but if you forget that part it's alright.
Re:Google removes pledge to not use AI for weapons from website by astrange on Tuesday February 04, 2025 @06:37PM (#42940917)
Palantir doesn't make autonomous weapons, they sell SQL queries and have an evil-sounding name because it recruits juniors who think the name is cool.

Might be thinking of Anduril.

Re:Google removes pledge to not use AI for weapons from website by cookiengineer on Tuesday February 04, 2025 @07:29PM (#42941550)
Palantir literally developed Lavender that has been used for autonomous targeting in the bombardments of the Gaza stripe.

Look it up.

Re:Google removes pledge to not use AI for weapons from website by pbiggar on Tuesday February 04, 2025 @07:54PM (#42941846)
Re:Google removes pledge to not use AI for weapons from website by trhway on Tuesday February 04, 2025 @07:02PM (#42941219)
Palantir provides combat management system in Ukraine. That system collect and analyzes intelligence, including drone video streams, and identifies targets. Right now people are still in the loop though that is naturally would go away in the near future I think.
Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @06:40PM (#42940958)
With or without autonomous weapons, war is always a sordid business with 'dead babies', this is not in itself a fact that tells us what weapons systems to develop.
Re:Google removes pledge to not use AI for weapons from website by darth_avocado on Tuesday February 04, 2025 @06:43PM (#42940992)
Yet there are boundaries on which weapons we can and cannot develop: Nuclear, Chemical, Biological etc.
Re:Google removes pledge to not use AI for weapons from website by _bin_ on Tuesday February 04, 2025 @08:19PM (#42942113)
those are mostly drawn on how difficult it is to manage their effects. chemical weapons are hard to target, nukes are too (unless one dials the yield down enough that there's little point) and make land unusable for years, and biological weapons can't really be contained to military targets.

we have, of course, developed all three. they have gone a long way towards keeping us safe over the past century.

Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @06:59PM (#42941178)
Indeed. Usually weapons are banned if the damage is high and indiscriminate while the military usefulness is low.

There is at this moment little evidence that autonomous weapons will cause more collateral damage than artillery shells and regular air strikes. The military usefulness on other other hand seems to be very high and increasing.

Re:Google removes pledge to not use AI for weapons from website by bluefirebrand on Tuesday February 04, 2025 @07:39PM (#42941661)
It seems like the sort of thing we shouldn't be wanting evidence of in order to avoid, though

Like skydiving without a parachute, I think we should accept it is a bad idea without needing a double blind study

Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @08:16PM (#42942086)
The risks needs to be weighed against the downside of not deploying a capable system against your enemies.
Re:Google removes pledge to not use AI for weapons from website by int_19h on Tuesday February 04, 2025 @08:59PM (#42942554)
It's a bit too late for that, since Ukraine and Russia are both already using AI-controlled drones in combat.
Re:Google removes pledge to not use AI for weapons from website by vasco on Wednesday February 05, 2025 @02:43AM (#42945249)
Not all is bad, it's preferable to have autonomous systems killing each other than killing humans. If it gets very prevalent you could even get to a point where war is just simulated war games. Why have an AI piloted F-35 fight a AI piloted J-36? Just do it on the computer. It's at least 1 or 2 less pilots that die in that case.
Re:Google removes pledge to not use AI for weapons from website by CamperBob2 on Tuesday February 04, 2025 @06:23PM (#42940711)
Tell Putin. He will entertain no such inhibitions.
Re:Google removes pledge to not use AI for weapons from website by ignoramous on Tuesday February 04, 2025 @06:37PM (#42940920)
> no such inhibitions

Propping up evil figure/regime/ideology (Bolsheviks/Communists) to justify remorseless evilness (Concentration camps/Nuclear bomb) isn't new nor unique, but particularly predictable.

Re:Google removes pledge to not use AI for weapons from website by gosub100 on Tuesday February 04, 2025 @08:10PM (#42942016)
nukes saved countless US lives being lost to a regime who brought us into it. And it's incalculable how many wars they have prevented.
Re:Google removes pledge to not use AI for weapons from website by CamperBob2 on Tuesday February 04, 2025 @06:51PM (#42941070)
Sadly, attempts at equating evil figures/regimes/ideologies with those who fight back against them are equally predictable.
Re:Google removes pledge to not use AI for weapons from website by vkou on Tuesday February 04, 2025 @07:21PM (#42941459)
We have Putin at home, he spent the past weekend making populist noises about annexing his neighbours over bullshit pretenses.

I'm sure this sounds like a big nothingburger from the perspective of, you know, people he isn't threatening.

How can you excuse that behaviour? How can you think someone like that can be trusted with any weapons? How naive and morally bankrupt do you have to be to build a gun for that kind of person, and think that it won't be used irresponsibly?

Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @07:32PM (#42941589)
I understand the sentiment but the logical conclusion of that argument is that the US should disarm and cease existing.
Re:Google removes pledge to not use AI for weapons from website by vkou on Tuesday February 04, 2025 @07:36PM (#42941627)
The better logical conclusion of that argument is that the US needs to remove him, and replace him with someone who isn't threatening innocent people.

That it won't is a mixture of cowardice, cynical opportunism, and complicity with unprovoked aggression.

In which case, I posit that yes, if you're fine with threatening or inflicting violence on innocent people, you don't have a moral right to 'self-defense'. It makes you a predator, and arming a predator is a mistake.

You lose any moral ground you have when you are an unprovoked aggressor.

Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @08:19PM (#42942120)
I'm not a fan of Trump but I also feel he has not been so bad that I think that surrendering the world order to Russia and China is a rational action that minimizes suffering. That seems be an argument that is more about signalling that you really dislike Trump than about a rational consideration of all options available to us.
Re:Google removes pledge to not use AI for weapons from website by vkou on Tuesday February 04, 2025 @08:24PM (#42942192)
It's not a shallow, dismissable, just-your-opinion-maaan 'dislike' to observe that he is being an aggressor. Just like it's not a 'dislike' to observe that Putin is being one.

There are more options than arming an aggressor and capitulating to foreign powers. It's a false dichotomy to suggest it.

Re:Google removes pledge to not use AI for weapons from website by kombine on Wednesday February 05, 2025 @03:44AM (#42945768)
> I'm not a fan of Trump but I also feel he has not been so bad

He literally threatened a peaceful nation (also an ally) of invasion and annexation. How worse can it get?

Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Thursday February 06, 2025 @12:42PM (#42964650)
If he actually did it that would be far worse.
Re:Google removes pledge to not use AI for weapons from website by pixl97 on Tuesday February 04, 2025 @07:46PM (#42941749)
Ya go poke people with nukes and see how that works out
Re:Google removes pledge to not use AI for weapons from website by vkou on Tuesday February 04, 2025 @08:06PM (#42941969)
You are making an excellent argument for nuclear proliferation.
Re:Google removes pledge to not use AI for weapons from website by _bin_ on Tuesday February 04, 2025 @08:21PM (#42942150)
"putin at home" is baseless flame-bait. delete your comment.
Re:Google removes pledge to not use AI for weapons from website by CamperBob2 on Tuesday February 04, 2025 @11:03PM (#42943613)
TBF, vkou's post disagrees with mine, but I don't disagree with it. If pressed to offer a forecast, I think the moral dilemmas we're about to face as Americans will be both disturbing and intimidating, with a 50% chance of horrifying.
Re:Google removes pledge to not use AI for weapons from website by sangnoir on Tuesday February 04, 2025 @07:57PM (#42941872)
It's not a luxury belief for a multinational tech company that intends to remain in business in countries that are not allied to the US. Being seen as independent of the military has a dollar value, but that may be smaller than value of defense contracts Google hopes to get.
Re:Google removes pledge to not use AI for weapons from website by captainbland on Tuesday February 04, 2025 @07:36PM (#42941623)
Whatever your feelings on that are, it's hardly unreasonable to have misgivings about your search and YouTube watches going to fund sloppy AI weapons programmes that probably won't even kill the right people.
Re:Google removes pledge to not use AI for weapons from website by darth_avocado on Tuesday February 04, 2025 @06:41PM (#42940977)
Weapons inherently aren’t evil, which is why everyone has kitchen knives. People use weapons to do evil.

The problem with building AI weapons is that eventually it will be in the hands of people who are morally bankrupt and therefore will use them to do evil.

Re:Google removes pledge to not use AI for weapons from website by gerdesj on Tuesday February 04, 2025 @07:14PM (#42941379)
Who is to say a wielder of a kitchen knife is not "morally bankrupt" - whatever that means.

In my garage, I have some pretty nasty "weapons" - notably a couple of chainsaws, some drills, chisels, lump/sledge/etc hammers and a fencing maul! The rest are merely: mildly malevolent.

You don't need an AI (whatever that means) to get medieval on someone. On the bright side the current state of AI (whatever that means) is largely bollocks.

Sadly, LLMs have and will be wired up to drones and the results will be unpredictable.

Re:Google removes pledge to not use AI for weapons from website by osmsucks on Tuesday February 04, 2025 @07:44PM (#42941732)
The difference there is that a knife has some obvious, benign use cases. Smart weapons targeting has only one use case, and it's to do harm to others.
Re:Google removes pledge to not use AI for weapons from website by xdennis on Tuesday February 04, 2025 @08:09PM (#42942004)
AI weapons do have benign use cases: harming enemies.

When China attacks with AI weapons do you expect the free world to fight back armed with moral superiority? No. We need even more lethal AI weapons.

Mutual assured destruction has worked so far for nukes.

Re:Google removes pledge to not use AI for weapons from website by osmsucks on Wednesday February 05, 2025 @02:27AM (#42945114)
Use of weapons is only benign to you if you're not on the receiving end. Imagine your family being blown up by a rocket because an AI system hallucinated that they're part of a dangerous terror cell.

My point though is that this is the only use case for such systems. The common comparisons to things like knives are invalid for this reason.

Re:Google removes pledge to not use AI for weapons from website by psunavy03 on Tuesday February 04, 2025 @06:59PM (#42941187)
Then we should be encouraging their development by the governments of liberal democratic nations as opposed to authoritarian regimes.
Re:Google removes pledge to not use AI for weapons from website by burningChrome on Tuesday February 04, 2025 @07:34PM (#42941612)
Serious question.

How would we go about doing that?

Every kind of nefarious way to keep the truth at bay in authoritarian regimes is always on the table. From the cracking of iPhones to track journalists covering these regimes, to snooping on email, to using AI to do this? Is just all the same thing, just updated and improved tools.

Just like Kevin Mitnick selling zero day exploits to the highest bidder, I have a hard time seeing how these get developed and somehow stay out of reach of the regimes you speak of.

Re:Google removes pledge to not use AI for weapons from website by leptons on Tuesday February 04, 2025 @07:17PM (#42941414)
A kitchen knife is a tool. It can be used as a weapon.

A car is a tool. It can be used as a weapon.

Even water and air can be used as a weapon if you try hard enough. There is probably nothing on this planet that couldn't be used as a weapon.

That said, I do not think AI weapons are a reasonable thing to build for any war, for any country, for any reason - even if the enemy has them.

Re:Google removes pledge to not use AI for weapons from website by gizmondo on Tuesday February 04, 2025 @08:00PM (#42941923)
> That said, I do not think AI weapons are a reasonable thing to build for any war, for any country, for any reason - even if the enemy has them.

So you're in favor of losing a war and becoming a subject of the enemy? While it's certainly tempting to think that unilateralism can work, I can hardly see how.

Re:Google removes pledge to not use AI for weapons from website by leptons on Tuesday February 04, 2025 @11:39PM (#42943880)
>So you're in favor of losing a war and becoming a subject of the enemy?

I never said that. Please don't reply to comments you made up in your head.

Using AI doesn't automagically equate to winning a war. Using AI could mean the AI kills all your own soldiers by mistake. AI is stupid, it just is. It "hallucinates" and often leads to wrong outcomes. And it has never won a war, and there's no guarantee that it would help to win any war.

Re:Google removes pledge to not use AI for weapons from website by Dalewyn on Tuesday February 04, 2025 @06:47PM (#42941036)
Much as it is the case with guns, why is the "problem" the tools or provider of the tools and not the user of the tools?
Re:Google removes pledge to not use AI for weapons from website by pixl97 on Tuesday February 04, 2025 @07:47PM (#42941763)
Depends if next years gun gets up and shoots you in the head on its own accord.
Re:Google removes pledge to not use AI for weapons from website by pyinstallwoes on Tuesday February 04, 2025 @06:59PM (#42941185)
“…so which is it then? Is it really robots that are wired to kill people, or the humans wiring them?”
Re:Google removes pledge to not use AI for weapons from website by int_19h on Tuesday February 04, 2025 @09:00PM (#42942559)
That's the problem with all weapons.

The concern with AI weapons specifically is that if something goes wrong, they might not even be in the hands of the people at all, but pursue their own objective.

Re:Google removes pledge to not use AI for weapons from website by ziddoap on Tuesday February 04, 2025 @06:19PM (#42940666)
>all weapons are evil

That wasn't the quote that was removed. Not even close, really.

Re:Google removes pledge to not use AI for weapons from website by astrange on Tuesday February 04, 2025 @06:36PM (#42940904)
It's definitely an opinion Google employees had in the last decade.

Actually I think a lot of people have it - just yesterday I saw someone on reddit claim Google was evil because it was secretly founded by the US military. And they were American. That's their military!

Re:Google removes pledge to not use AI for weapons from website by gosub100 on Tuesday February 04, 2025 @08:13PM (#42942051)
they have no problems heavily censoring law-abiding gun youtubers. Even changing the rules and giving them strikes retroactively. I guess it's "weapons for me, but not for thee".
Re:Google removes pledge to not use AI for weapons from website by jjj123 on Tuesday February 04, 2025 @06:52PM (#42941091)
It’s my military too and I believe the US military does many, many evil things that I want no part of.
Re:Google removes pledge to not use AI for weapons from website by astrange on Tuesday February 04, 2025 @08:15PM (#42942082)
I think the thing to remember is, however bad it is, it could always get worse.

A world without the US navy is one without sea shipping because pirates will come back.

Re:Google removes pledge to not use AI for weapons from website by dark_glass on Tuesday February 04, 2025 @07:11PM (#42941331)
"We sleep safely at night because rough men stand ready to visit violence on those who would harm us"
Re:Google removes pledge to not use AI for weapons from website by switchbak on Tuesday February 04, 2025 @07:33PM (#42941594)
And these same organizations fuel conflicts that actively make the USA less safe. These organizations can both do great things (hostage rescues) and terrible things (initiating coups), and it’s upon the citizenry to ensure that these forces are put to use only where justified. That is to say almost never.
Re:Google removes pledge to not use AI for weapons from website by astrange on Tuesday February 04, 2025 @07:59PM (#42941901)
We've stopped South American coups more recently than we've initiated them. (in the last few years, in Brazil and Bolivia)
Re:Google removes pledge to not use AI for weapons from website by switchbak on Wednesday February 05, 2025 @04:00PM (#42955052)
Truly, the last few minutes of American history is not material to the argument I’m making here.

And I don’t doubt there’s still a lot of subterfuge happening as we speak, most of which we’ll never hear about until something goes very wrong.

Re:Google removes pledge to not use AI for weapons from website by bbqfog on Tuesday February 04, 2025 @07:23PM (#42941474)
The US is not under any kind of credible threat and in fact is the aggressor across the globe and perpetrator of crimes against humanity at scale. This is not a recent phenomena and has been going on as long as this country has existed.
Re:Google removes pledge to not use AI for weapons from website by tmnvdb on Tuesday February 04, 2025 @08:33PM (#42942299)
The US mainland is not currently under threat but the US world system is.
Re:Google removes pledge to not use AI for weapons from website by bbqfog on Wednesday February 05, 2025 @09:49AM (#42949199)
That's absolutely no reason to attack anyone.
Re:Google removes pledge to not use AI for weapons from website by aprilthird2021 on Tuesday February 04, 2025 @07:13PM (#42941357)
It's a luxury belief to think you won't one day be scanned by an AI to determine if you're killable or not
Re:Google removes pledge to not use AI for weapons from website by ignoramous on Tuesday February 04, 2025 @06:41PM (#42940969)
> all weapons are evil is an insane luxury belief

It isn't this that's insane, but a total belief purity of weapons that is.

Re:Google removes pledge to not use AI for weapons from website by psunavy03 on Tuesday February 04, 2025 @07:00PM (#42941205)
You don't have to have a "total believe in the purity of weapons" to recognize that military tech is a regrettable but necessary thing for a nation to pursue.
Re:Google removes pledge to not use AI for weapons from website by ignoramous on Tuesday February 04, 2025 @10:11PM (#42943230)
> You don't have to have "total belief in the purity of weapons"...

Of course. My point was, it is insane for those who do.

Re:Google removes pledge to not use AI for weapons from website by PessimalDecimal on Wednesday February 05, 2025 @12:19AM (#42944147)
You're either misdirecting the discussion, or have missed the point. The statement isn't about weapons, but the means of _control_ of weapons.

It's legitimate to worry about scaled, automated control of weapons, since it could allow a very small number of people to harm a much larger number of people. That removes one of our best checks we have against the misuse of weaponry. If you have to muster a whole army to go kill a bunch of people, they can collectively revolt. (It's not always _easy_ but it's possible.)

Automating weapons is a lot like nuclear weapons in some ways. Once the hard parts are done (refining raw oar), the ability for a small number of people to harm a vast number of others is serious. People are right to worry about it.