Re:Sam and Greg's response to OpenAI Safety researcher claims
by badestrand on Sunday May 19, 2024 @12:25AM
(#40404270)
That rather sounds like Palantir is dangerous and not OpenAI.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by Skgqie1 on Sunday May 19, 2024 @01:16AM
(#40404438)
Yes, having eyes is incredibly dangerous. It allows people to select a target from anything they can see.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by mnyary on Sunday May 19, 2024 @06:42AM
(#40405910)
”Another Lavender user questioned whether humans’ role in the selection process was meaningful. “I would invest 20 seconds for each target at this stage, and do dozens of them every day. I had zero added-value as a human, apart from being a stamp of approval. It saved a lot of time.”
This article is more than 1 month old
‘The machine did it coldly’: Israel used AI to identify 37,000 Hamas targets; Guardian, 2 Apr 2024
Re:Sam and Greg's response to OpenAI Safety researcher claims
by mr_mitm on Sunday May 19, 2024 @02:25AM
(#40404671)
But the claim was "th gravest of dangers". While your scenario is a nightmare, I'm not sure it qualifies as "the gravest".
Re:Sam and Greg's response to OpenAI Safety researcher claims
by nl on Sunday May 19, 2024 @04:41AM
(#40405358)
> map tool lets users “nominate targets of interest” for “the target nomination process”. She meant it helps people choose which places get bombed.
So... people are choosing who to kill?
I'm reasonably sure there are historical precedents for this.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by int_19h on Tuesday May 21, 2024 @04:07AM
(#40425408)
The danger here is that the model hallucinates while "simplifying" and omits important information that would prevent a strike.
Or, if you're more conspiracy-minded (which is not necessarily unwarranted with the likes of Palantir), the model can be deliberately induced into "simplifying" away collateral damage through careful prompting, providing a veneer of plausible deniability.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by Terretta on Sunday May 19, 2024 @10:23AM
(#40407174)
> ... map tool lets users “nominate targets of interest” for “the target nomination process” ... These blobs, she said, were civilian areas like hospitals and schools. ... where children sleep and families get medical treatment." ... Definitely not dangerous at all.
Have you typed "school" or "hospital" in Google Maps?
This argument reduces to: any knowledge that can be misused is dangerous.
More murders in America are committed with hammers than long guns, yet we don't regulate hardware stores.
"...I also went to a panel in Palantir’s booth titled Civilian Harm Mitigation. It was led by two “privacy and civil liberties engineers” – a young man and woman who spoke exclusively in monotone. They also used countless euphemisms for bombing and death. The woman described how Palantir’s Gaia map tool lets users “nominate targets of interest” for “the target nomination process”. She meant it helps people choose which places get bombed.
After she clicked a few options on an interactive map, a targeted landmass lit up with bright blue blobs. These blobs, she said, were civilian areas like hospitals and schools. The civilian locations could also be described in text, she said, but it can take a long time to read. So, Gaia uses a large language model (something like ChatGPT) to sift through this information and simplify it. Essentially, people choosing bomb targets get a dumbed-down version of information about where children sleep and families get medical treatment."
Definitely not dangerous at all.