News for hackers. Stuff that matters.
Re:OpenAI Preparedness Challenge by mk_stjames on Thursday October 26, 2023 @03:36PM (#38030695)
This kinda of crowdsourcing just feels.... f'ing weird man.

It's like if, after the 1993 WTC bombing, but before 9/11, the FBI and NY Port Authority went around asking people how they would attack NYC if they were to become terrorists and... then how they would suggest detecting and stopping said attack. And please be as detailed as possible. Leave your name and phone number. Best answer gets season tickets to the Yankees!

Re:OpenAI Preparedness Challenge by lainga on Thursday October 26, 2023 @03:49PM (#38030829)
Re:OpenAI Preparedness Challenge by Angostura on Thursday October 26, 2023 @04:17PM (#38031168)
Fascinating. Thank you
Re:OpenAI Preparedness Challenge by jiggawatts on Thursday October 26, 2023 @03:51PM (#38030865)
That is essentially what happened!

The FBI asked researchers and university professors precisely this question. They then used the proposed attack vectors to formulate a plan to protect the nation.

This was all supposed to be done in secret. After all, we don’t want to “give the terrorists ideas.”

The reason I know about this at all is because someone found one such paper was accidentally published on a public FTP site alongside a bunch of non-classified government-funded research.

The content was horrifying. One professor came up with a laundry list of imaginative ways to end society… on a budget.

Re:OpenAI Preparedness Challenge by mk_stjames on Thursday October 26, 2023 @04:15PM (#38031140)
"This was all supposed to be done in secret."

That's the difference and why this feels different, IMO. It's one thing for an agency to go around and interview subject matter experts and talk about ways things could happen and how to prevent them.

It's another thing to just... setup such a bright and cheery webpage for everyone and so plainly state what they want people to do.

It's also the fact that it's done in a way to leverage free labor- not that, if FBI agents were going to university professors, experts in biochem, etc, that they would be paying them... but, it would be done in a more structured, professional manner with agents putting in the work to sum things up and report back.

This is just... it feels like getting the internet to do your homework. Your counterterrorism class homework.

Maybe that actually is the best way to do it. But it still feels odd.

Re:OpenAI Preparedness Challenge by jerbear4328 on Thursday October 26, 2023 @03:55PM (#38030917)
...is there a link? I am very curious now.
Re:OpenAI Preparedness Challenge by jiggawatts on Thursday October 26, 2023 @05:57PM (#38032229)
This was about twenty years ago, and I lost the file to disk corruption.

I do remember some of the proposed attacks.

The most of scary one was if the terrorists have a decent number of people is to drive around and destroy transformers at electricity substations.

A lot of those locations are unmanned and have minimal security.

The risk is that there just aren’t that many spare transformers available globally above a certain size and they take months to build.

If you take out enough of them fast enough, you can cripple any modern energy-dependent economy.

This tactic very nearly worked for Russia in Ukraine.

Re:OpenAI Preparedness Challenge by gensym on Thursday October 26, 2023 @03:56PM (#38030941)
I remember Bruce Schneier calling them "Movie plot threats". ex: https://www.schneier.com/blog/archives/2005/10/exploding_bab...
Re:OpenAI Preparedness Challenge by naillo on Thursday October 26, 2023 @03:53PM (#38030892)
Don't let the llm training sets see this
Re:OpenAI Preparedness Challenge by kirykl on Thursday October 26, 2023 @03:51PM (#38030869)
Best answer gets 25,000 lbs of explosive
Re:OpenAI Preparedness Challenge by BasedInfra on Thursday October 26, 2023 @03:56PM (#38030936)
This did happen internally and with authors like Tom Clancy and Brad Meltzer they came up with scenarios and mitigation.

Also have the Red Cell unit made to mock attack US infrastructure and bases although they got a bit too real one time.

https://en.m.wikipedia.org/wiki/Red_Cell

Re:OpenAI Preparedness Challenge by GistNoesis on Thursday October 26, 2023 @04:20PM (#38031196)
Sama: Yeah so if you ever need some dataset for an evil AI.

Sama: Just ask.

Sama: I have over 4000 ideas, how-tos, guides for and by malicious actors,

[Redacted Friend's Name]: What? How"d you manage that one?

Sama: People just submitted it.

Sama: I don't know why.

Sama: They "trust me"

Sama: Dumb f***s.

Re:OpenAI Preparedness Challenge by gardenhedge on Thursday October 26, 2023 @04:57PM (#38031599)
I see it as a great thing. I'm sure they could just get the top 10 AI "experts" in a room but why limit it like that?