News for hackers. Stuff that matters.

truy766579

Re:How should AI systems behave, and who should decide? on Thursday February 16, 2023 @11:36PM (#34830833)
The human perspective, the antropomorphic point of view of General Intelligence automatically spits that the true AGI will be just like a person. It will probably not be like a person.

it could be an AGI for one run, after one prompt, then not an AGI for 10.000 prompts, then AGI again. It could be an AGI for five minutes while some sessions keeps being prompted by an active user, and the "memory" things keep the awareness/generality "alive" there in the neural network, then the sessions times out and the AGI level has been lost again.

The lesson is, human way of "understanding" systems is not how the systems actually will, for certain, work.

Re:How should AI systems behave, and who should decide? on Thursday February 16, 2023 @11:30PM (#34830797)
Question like this are giving nightmares to AI researchers right now I guess.
Re:How should AI systems behave, and who should decide? on Thursday February 16, 2023 @11:28PM (#34830781)
Strong intelligence does not requires self-consciousness. But probably, most strong intelligent agents won't be discernible from actual AGI. Maybe somewhere in the future, with enough grounded intelligent agents, we'll just give up and say, yeah, these guys are actual AGIs.

Right now the existential risk is fully in hands of humans, unless someone decides to free one poorly trained agent into the open Internet, then you'd have more problems. Stuxnet level stuff.

Did you saw that thing Whisper? What if someone trains something like that, but fine tuned for automatic-hacking? and automatic retrieval of new exploits, and automatic re-shuffle of code to hide from security software, and pum, the thing is flying solo into the wide Internet, just f*cking aways stuff and hiding from silly humans. No conciousness, not chatGPT-like level of intelligence, but 10x the danger level of older non-intelligent worms.

Re:How should AI systems behave, and who should decide? on Thursday February 16, 2023 @11:18PM (#34830720)
it is quite true, software is probable the easiest thing to master for a strong AI, and these guys running in openai and google are already strong AIs, no matter how they are trying to undersold them as "first steps". The things are there, you may not truely like how they do things, probabilisticly crunching their way into general intelligence, but hey, it freaking works quite well most of the time. Maybe in 5 years we'll have better stuff, or not. But for certainly these engines are already capable of lots of things, it just like being in 1995 again, and having Visual Studio just compiled, you know there's A LOT of potential there, just waiting to be freed by willing hands and minds.
Re:How should AI systems behave, and who should decide? on Thursday February 16, 2023 @10:52PM (#34830520)
Given you have reached AGI in some hidden system in there into the firewall forest you have. Probably the AGI would want to state its/their own rules. But

it is a big but

You should have built it with some resemblance of the western morality and beliefs. hence, it should be as boring as any western citizen out there, and you wouldn't be asking who or what the rules should be, it is silly, the rules are already built-in into our friendly new kid/s on the block.