News for hackers. Stuff that matters.
Re:Microsoft lays off an ethical AI team as it doubles down ... by swyx on Tuesday March 14, 2023 @03:21AM (#35148315)
no evidence? none? Google Lambda and Bing/Sydney are not at least incrementally closer to evidence?
Re:Microsoft lays off an ethical AI team as it doubles down ... by bonzini on Tuesday March 14, 2023 @04:31AM (#35148716)
That's not AGI. An AGI would be able to tell you they don't know things, ask for clarification as to why you think they're wrong, etc.

ChatGPT just spouts out a different wild guess when you tell it it's wrong, but doesn't learn from its mistake—not even within a single chat. Sydney just goes full psychopath.

Re:Microsoft lays off an ethical AI team as it doubles down ... by EVa5I7bHFq9mnYK on Tuesday March 14, 2023 @08:28AM (#35150388)
That's not AGI. AGI would be able to write its own code, and improve it exponentially.
Re:Microsoft lays off an ethical AI team as it doubles down ... by nradov on Tuesday March 14, 2023 @08:41AM (#35150525)
That's a big assumption. No one has built an AGI yet so we don't know whether an AGI would be capable of improving it's own code exponentially. Any exponential growth function quickly runs into hard physical limits.
Re:Microsoft lays off an ethical AI team as it doubles down ... by AstralStorm on Tuesday March 14, 2023 @08:43AM (#35150555)
Not necessarily, much like every human does not know pharmacology, genetics, robotics or other specialties that could be used for self improvement. Including social engineering and programming.

What you're describing is a particular kind of superintelligence, recursively improving kind. Between that and general intelligence is another gap.

Re:Microsoft lays off an ethical AI team as it doubles down ... by EVa5I7bHFq9mnYK on Tuesday March 14, 2023 @01:41PM (#35155354)
Humanity as a whole can improve itself indefinitely, there is little doubt about that. For robots, there is no distinction between a single robot and robotuity, as software can be replicated cheaply and quickly.
Re:Microsoft lays off an ethical AI team as it doubles down ... by CuriouslyC on Tuesday March 14, 2023 @08:52AM (#35150671)
We're generally intelligent but we can't consciously rewire our brains.
Re:Microsoft lays off an ethical AI team as it doubles down ... by pnut on Tuesday March 14, 2023 @09:40AM (#35151325)
We sort of can, through meditation, habit, study, and chemical alteration - obviously within constraints, barring future technological enhancements.
Re:Microsoft lays off an ethical AI team as it doubles down ... by EVa5I7bHFq9mnYK on Tuesday March 14, 2023 @01:26PM (#35155072)
We can, this process is called "learning".
Re:Microsoft lays off an ethical AI team as it doubles down ... by CuriouslyC on Tuesday March 14, 2023 @02:52PM (#35156644)
Practice and study are conscious behaviors. Learning is not.
Re:Microsoft lays off an ethical AI team as it doubles down ... by hgsgm on Tuesday March 14, 2023 @09:15AM (#35150918)
That's Super Intelligent AGI, not merely AGI.
Re:Microsoft lays off an ethical AI team as it doubles down ... by mcguire on Tuesday March 14, 2023 @03:09PM (#35156869)
None of the existing models of what we call 'general intelligence' are capable of improving themselves exponentially.
Re:Microsoft lays off an ethical AI team as it doubles down ... by Arkhaine_kupo on Tuesday March 14, 2023 @06:06AM (#35149327)
> Google Lambda and Bing/Sydney are not at least incrementally closer to evidence?

No, in the same way that boiling water in a kettle is not incrementally closer to inventing the fuel for a rocket ship.

You can, in hidsight do a linear connection of water boiling -> steam engine -> fuel engine -> aeronautics -> space travel

But the first time someone boiled water, if you said that got you closer to being on the moon I think you would be mad. There is a non trivial chance that all our current work in AI is functionally useless in terms of creating AGI, it might take a complete breakthrough in ML, tech not invented yet, or it might not be possible at all.

Re:Microsoft lays off an ethical AI team as it doubles down ... by SturgeonsLaw on Tuesday March 14, 2023 @07:52AM (#35150055)
Except, in your example, boiling water did get us closer to the moon :)
Re:Microsoft lays off an ethical AI team as it doubles down ... by Arkhaine_kupo on Tuesday March 14, 2023 @08:24AM (#35150344)
Yep, and there was a much mre promissing science on checking Ether, and the magical qualities of gravity defying physics.

Who is to say that our current ML models are not Ether studies and utterly useless.

If we crack AGI in 10 years, maybe our current models are the fuel engine. But if they are not even close, we might be boiling water. Or perhaps be wrong all together, thats why I said your observation of us getting closer thanks to those proyects is not right, at least not yet.

Re:Microsoft lays off an ethical AI team as it doubles down ... by CuriouslyC on Tuesday March 14, 2023 @08:51AM (#35150655)
We have lots of examples of generally intelligent systems, they're common and they evolve by themselves, so the idea that it might not be possible at all just seems ridiculous.

Large language models might not be capable of general intelligence by themselves, but a model network that includes a LLM as part of a generalized game playing model would certainly have the potential to get there.

Re:Microsoft lays off an ethical AI team as it doubles down ... by RandomLensman on Tuesday March 14, 2023 @09:34AM (#35151220)
I think it is fair to say that "not at all possible" is perhaps too strong. On the potential of certain approaches I am less certain we have or know what we need.

But we also have examples of things all around us we cannot make ourselves (e.g., a simple animal or lifeform from scratch).

Re:Microsoft lays off an ethical AI team as it doubles down ... by CuriouslyC on Tuesday March 14, 2023 @11:21AM (#35152942)
Except that we've already created synthetic genomes: https://www.nytimes.com/2019/05/15/science/synthetic-genome-...

If we can define what "generally intelligent" means in concrete terms, we can absolutely create it. The problem is that we don't have a good understanding/shared idea of what we're trying to achieve. We can create models that can learn to play many different games using the same weights, solve IQ/logic tests and pass the Turing test consistently, but people are going to move the goalposts and say those are just complex mashups of autocomplete and flowcharts.

To be honest I don't think AI skeptics are ever going to believe until there's a Skynet trying to exterminate them.

Re:Microsoft lays off an ethical AI team as it doubles down ... by RandomLensman on Tuesday March 14, 2023 @11:58AM (#35153628)
I don't share the view that all that is holding us back from creating AGI is a definition. Btw., that synthetic genome is a long way from making even something like an little nematode.

I rather think AGI "idealists" (maybe there is a better word) will forever hold out (any) algorithmic advances as a sign of the immanent creation of AGI proper.