Large language models in national security applications

Re:Large language models in national security applications by perihelions on Tuesday November 12, 2024 @02:11PM (#42118582)

The most obvious way the US national security industry could use LLM's right now is simply to spam foreign adversaries with chatbots. That's their greatest strength right now—a use-case they have amply proven themselves for.

This paper comes off as eager to avoid this topic: they (briefly) talk about detecting foreign LLM spam, which is called propaganda, but sidestep the idea of our own side using it. If we were considering talking about that, we wouldn't choose negative-sentiment descriptors like (quoting the paper) "nation-state sponsored propaganda", or "disinformation campaigns"; we'd use our own netural-sentiment jargon, which is "psychological operations" ("psyops") [0].

That we're not widely debating this question right now *probably* means it's far too late to have a chance of stopping it.

edit: Or, to rephrase this as a question: Is it ethical to spam another democracy with millions of chatbots pretending to be citizens of that country—if the effect is to manipulate those citizens to not go to war with our own side, saving our own lives? Is that an atrocity or is that legitimate warfare?

[0] https://en.wikipedia.org/wiki/Psychological_operations_(Unit...

[ Parent | on HN ]

Re:Large language models in national security applications by Onavo on Tuesday November 12, 2024 @03:54PM (#42119627)

The platform you are referring to is called "Reddit", one of YC's portfolio companies.

[ Parent | on HN ]

Re:Large language models in national security applications by bilbo0s on Tuesday November 12, 2024 @02:47PM (#42118963)

Or, to rephrase this as a question: Is it ethical to spam another democracy with millions of chatbots pretending to be citizens of that country—if the effect is to manipulate those citizens to [take any action advantageous to US national interest]...?

Just, Devil's Advocate, but ethical or not, that's what we should be doing and what we are doing. Every nation has its sock puppets out there, our job is to stop everyone else' sock puppets, and do everything we can to extend the reach of our own sock puppets.

[ Parent | on HN ]

Re:Large language models in national security applications by JoshTriplett on Tuesday November 12, 2024 @03:31PM (#42119418)

That's not inherently true. If there were a way to reliably destroy all the sock puppets, we should, and the world would be better off. For instance, reliable bot detection, or mechanisms by which major social networks could detect and prohibit bot-like activity that isn't labeled as such.

[ Parent | on HN ]

Re:Large language models in national security applications by exe34 on Tuesday November 12, 2024 @04:15PM (#42119778)

charge one penny for every post. most people can afford it. bots become less cost effective and you'd be able to trace the source of funds.

[ Parent | on HN ]

Re:Large language models in national security applications by recursive on Tuesday November 12, 2024 @05:01PM (#42120238)

Even if they could afford it, they won't. The UX friction of charging money would send engagement off a cliff, even if the nominal charge was $0.

[ Parent | on HN ]

Re:Large language models in national security applications by hatthew on Tuesday November 12, 2024 @07:34PM (#42121635)

Only half joking, I feel like the majority of comments on the internet are garbage and not worth the time to read, and increasing friction with a nominal charge isn't necessarily a terrible thing.

[ Parent | on HN ]

Re:Large language models in national security applications by recursive on Tuesday November 12, 2024 @08:38PM (#42122041)

It's a good thing for most people, just not the "platforms" trying to show growth.

[ Parent | on HN ]

Re:Large language models in national security applications by exe34 on Tuesday November 12, 2024 @05:05PM (#42120283)

that's why it should be mandated by law for national security reasons!

[ Parent | on HN ]

Re:Large language models in national security applications by alisonatwork on Tuesday November 12, 2024 @06:50PM (#42121335)

This is a nice idea, but we already know that organized criminals and state actors have no problem spending money to make money (or influence public opinion).

On top of that, social media isn't like email where a potential transaction fee increases the cost per person reached - a single post on a hot topic could get millions of views.

[ Parent | on HN ]

Re:Large language models in national security applications by idle_zealot on Tuesday November 12, 2024 @06:48PM (#42121317)

I don't think you understand the Devil's Advocate rhetorical device. It's not just a thing you say before you state a morally reprehensible opinion you hold.

[ Parent | on HN ]

Re:Large language models in national security applications by Sabinus on Tuesday November 12, 2024 @10:09PM (#42122499)

Imo there's a difference between propaganda promoting functioning democracy and propaganda promoting conservative-at-best authoritarianism.

[ Parent | on HN ]

Re:Large language models in national security applications by itishappy on Tuesday November 12, 2024 @07:34PM (#42121626)

Why stop there? Send missiles! Heck, send bioweapons and dirty bombs. It might not be ethical but if others doing it we might as well join 'em.

(This is sarcasm. I don't want to live in this world.)

[ Parent | on HN ]

Re:Large language models in national security applications by immibis on Wednesday November 13, 2024 @12:40AM (#42123238)

We do.

[ Parent | on HN ]

Re:Large language models in national security applications by joe_the_user on Tuesday November 12, 2024 @02:45PM (#42118930)

Oh, national security professionals aren't going to be talking about psyops, offensive applications and etc, because such things make a given state look bad - they're an offense against democracy and respect for facts and they make the overt media of a given nation look bad. But hey, leave it to HN commentators to root for taking the gloves off. Not to worry post, I'd bet dollars to donuts the actual classified discussions of such things aren't worried about such niceties. But even more, in those activities of the US and other secret states, that have come to light, these state have propagandized not only enemy populations but also their own. After, have to counter enemies trying to nefariously prevent wars as well.

[ Parent | on HN ]

Re:Large language models in national security applications by davisp on Tuesday November 12, 2024 @07:43PM (#42121700)

I honestly can’t decide if this comment is written by AI or the moral equivalent of a distracted driver.

Overt media of a given nation.

Not to worry post

Classified discussions (could be me not being in natsec, but the only time I’ve heard this phrase is in movies)

After, have to counter enemies trying to nefariously prevent wars as well (I am unable to determine a possible typo that makes this sentence make sense)

[ Parent | on HN ]

Re:Large language models in national security applications by jingyibo123 on Tuesday November 12, 2024 @10:17PM (#42122544)

I'm pretty sure that before the era of LLM, hired personnel and computer chatbots already exists on major social media platform to serve as "opinion influencers", either for political or commercial purposes. Just that chatbot algorithms are kid of naive, and have been "fished" on several occasions....

The usage of LLM is too obvious, and way cheaper than hired personnel, so it's like "prism". They don't want us to talk about it because it's been going on for so long...

[ Parent | on HN ]

Re:Large language models in national security applications by immibis on Wednesday November 13, 2024 @12:38AM (#42123229)

They have, and it scales orders of magnitude better with LLMs.

[ Parent | on HN ]

Re:Large language models in national security applications by PittleyDunkin on Wednesday November 13, 2024 @01:50AM (#42123530)

I'm sure they're already used against both foreign and domestic populations.

[ Parent | on HN ]