News for hackers. Stuff that matters.
Re:On the Catastrophic Risk of AI by gensym on Thursday June 01, 2023 @11:40AM (#36152723)
> Unaligned intelligence is dangerous. You don't need a Sci-fi book to realize this, just a history one. > Our history is replete with examples of the slightly more technologically advanced group decimating their competition.

Are we talking about individual levels of intelligence, or are we talking about groups with advanced technology? Do you understand why those are not the same thing?

Re:On the Catastrophic Risk of AI by og_kalu on Thursday June 01, 2023 @01:02PM (#36154056)
Any Unaligned intelligence is dangerous. People get murdered because the perpetrator's desire to kill is unaligned with the victim's desire to live. The only thing that changes is the scope of danger.

Look at how we're giving LLMs more and more agency, embodiment and tool control. They're being "plugged" into everything. Palantir even has a military use LLM they're excitedly showcasing. They're several popular repos that give control of your terminal and browser to LLMs. The moment we built something showcasing strong general intelligence, we began to use it to make cognitive decisions and take actions in our stead.

Now an LLM browses the web for you. And as soon as June with Windows, it'll take actions on your computer for you as well.

If anything this recent LLM era has shown, it's that general AI won't need to escape any "box" because two sides will be missing.

No point saying "well a person can't kill thousands on his/her own so an ai won't be able to" when you have the ai influencing military tactics on a global scale.

General Super Intelligence will evidently not be as blacked boxed as any one human and that's not even taking into account whatever advantage super intelligence will bring.