News for hackers. Stuff that matters.
Re:Microsoft Phi-2 model changes licence to MIT by borissk on Saturday January 06, 2024 @06:30AM (#38890543)
Don't think this is the biggest danger. In a few years if they continue to improve at the current speed these models can become really dangerous. E.g. an organization like ISIS can feed one some books and papers on chemistry and ask it "I have such and such ingredients available, what is the deadliest chemical weapon of mass destruction i can create". Or use it to write the DNA for a deadly virus. Or a computer virus. Or use one to contact millions of say Muslim young men and try to radicalize them.
Re:Microsoft Phi-2 model changes licence to MIT by Y_Y on Saturday January 06, 2024 @06:36AM (#38890583)
Why radicalize only Muslims? Why do you need an LLM to teach you how to make a bomb?

Why not just ask it how to reach heaven with the lowest effort possible? Why don't good guys like you have your LLM pre-un-radicalize all those poor young men?

Re:Microsoft Phi-2 model changes licence to MIT by dist-epoch on Saturday January 06, 2024 @08:55AM (#38891449)
> Why not just ask it how to reach heaven with the lowest effort possible?

Becoming a martyr is the fastest way and with the lowest effort.

Re:Microsoft Phi-2 model changes licence to MIT by EnigmaFlare on Saturday January 06, 2024 @12:44PM (#38893420)
Indeed. Pretty much any horrible way to die from the olden days makes you a martyr in Islam. For example, having a building fall on you or gastro-intestinal disease. Fighting is only one of the ways and not really the easiest since the other ways are passive.
Re:Microsoft Phi-2 model changes licence to MIT by jafitc on Saturday January 06, 2024 @06:51AM (#38890668)
Do you think the ISIS is bound by the words “non-commercial” in a license file when they have the source anyway?

It was available even before this, all they changed is that law abiding citizens can put apps in the App Store and charge money for it.

(More importantly law abiding companies can build on and fine tune it in hopes of profit).

Re:Microsoft Phi-2 model changes licence to MIT by borissk on Saturday January 06, 2024 @10:11AM (#38892036)
I haven't said anything regarding a license - where did you get that from?

ISIS, etc. can easily abuse an open-source model and abusing a closed source model running in the cloud, e.g. ChatGPT 4 is a lot harder.

Re:Microsoft Phi-2 model changes licence to MIT by realPtolemy on Saturday January 06, 2024 @06:34AM (#38890571)
They can already do that with some simple googling.
Re:Microsoft Phi-2 model changes licence to MIT by borissk on Saturday January 06, 2024 @10:08AM (#38892013)
No, they can't - they would have done it if they could. Producing a practical chemical weapon is a complicated task, with many steps that are not documented in publicly available sources.
Re:Microsoft Phi-2 model changes licence to MIT by acdha on Saturday January 06, 2024 @10:29AM (#38892192)
That’s somewhat true – it’s not easy but not hard enough, as we saw with the Aum Shinrikyo attacks – but an LLM won’t magically have access to non-public instructions and, not having an understanding of the underlying principles, won’t be able to synthesize a safe process from public information.
Re:Microsoft Phi-2 model changes licence to MIT by pixl97 on Saturday January 06, 2024 @12:20PM (#38893218)
Eh that is up for debate. If I dump a library of chemistry books and industry books on chemistry and volatile chemicals its distinctly possible the model could generate this data.
Re:Microsoft Phi-2 model changes licence to MIT by acdha on Saturday January 06, 2024 @12:30PM (#38893304)
Not without some kind of understanding of the underlying principles. If you were testing something verifiable in code you might be able to test candidates at scale, but this involves a number of real-world processes which would be hard to tackle that way.
Re:Microsoft Phi-2 model changes licence to MIT by sgift on Saturday January 06, 2024 @01:05PM (#38893602)
Control of materials is a far bigger hurdle. If you try to procure materials which can be used for bombs/chemical weapons/.. in significant quantities you will get noticed pretty fast.
Re:Microsoft Phi-2 model changes licence to MIT by Baldbvrhunter on Saturday January 06, 2024 @11:56AM (#38892983)
The same ISIS who released "You Must Fight Them O Muwahhid" [0] with step-by-step instructions for the construction of home made triacetone triperoxide (TATP) bombs as used in the 2017 Manchester Arena attack, the 2015 Paris attacks and the July 7, 2005 London bombings, isn't hoping someone releases an uncensored LLM it can use in 24Gb VRAM so it knows what to do next.

[0] https://www.counterextremism.com/blog/infamous-isis-bomb-mak...