News for hackers. Stuff that matters.
Re:On the Catastrophic Risk of AI by pantalaimon on Thursday June 01, 2023 @10:47AM (#36151781)
intelligence with no influence on the real world (and currently not even any form of long-term memory) is a lot less dangerous.
Re:On the Catastrophic Risk of AI by og_kalu on Thursday June 01, 2023 @10:51AM (#36151839)
In recent months there's been a general direction to grant LLMs more and more agency, embodiment and tool control. They're being "plugged" into everything. Palantir even has a military use LLM they're excitedly showcasing. They're several popular repos that give control of your terminal and browser to LLMs.

The moment we built something showcasing strong general intelligence, we began to use it to make cognitive decisions and take actions in our stead.

Now an LLM browses the web for you. And as soon as June with Windows, it'll take actions on your computer for you as well.

If anything this recent LLM era has shown, it's that general AI won't need to escape any "box" because two sides will be missing. I don't think the idea that whatever Super Intelligence we build won't have influence on the real world will pan out at all.

Even the most isolated form of Super Intelligence will have Humans taking instructions from it. Instructions that you won't really be able to verify is ultimately for your own good.

Re:On the Catastrophic Risk of AI by Tostino on Thursday June 01, 2023 @11:08AM (#36152132)
Completely agree here.

And the fact of the matter is, long term memory is actively being worked on. You can already approximate reasonably with a Vector DB and embeddings, feeding the relevant results into the context.

As is increasing the "working memory" (context size) in a more efficient manner: https://arxiv.org/abs/2305.16300

This isn't even getting into using things like Tree of Thought techniques to improve reasoning abilities and limit the search space for each portion of the problem to a reasonable size.

Re:On the Catastrophic Risk of AI by hackinthebochs on Thursday June 01, 2023 @11:09AM (#36152160)
Exactly. The idea that an AGI will be contained in a virtual box is a non-starter. That ship has already sailed.
Re:On the Catastrophic Risk of AI by calf on Thursday June 01, 2023 @01:50PM (#36154778)
If only Michael Crichton were alive, I bet he'd have something penetrating to say about all the naive hype as well as the naive anti-hype/rationalizations.