News for hackers. Stuff that matters.
Re:'I Worked on Google's AI. My Fears Are Coming True' by dougmwne on Tuesday February 28, 2023 @10:03AM (#34970034)
Yes, I’m also familiar with that Clarke quote. I do understand how these models work on a mechanical level, but we certainly have not unpacked all the emergent behavior. What exactly is your evidence that there couldn’t be more going on?

Once we have the ability to X-ray the black box and we only find simple conditional correlations behind an existential conversation, then I would agree with you, but we haven’t done that yet.

Re:'I Worked on Google's AI. My Fears Are Coming True' by theGnuMe on Tuesday February 28, 2023 @10:05AM (#34970061)
Read up on conditional probability.
Re:'I Worked on Google's AI. My Fears Are Coming True' by dougmwne on Tuesday February 28, 2023 @10:19AM (#34970244)
I already said it might be no more than conditional correlations. That does not account for an emergent combination of conditionals that could implement some undiscovered algorithms of sentience.

If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient.

But the fact that our own sentience is a mystery means that there’s not a whole lot we can say mechanically about these LLM other than talk about their behavior and whether it’s convincing.

Re:'I Worked on Google's AI. My Fears Are Coming True' by barking_biscuit on Tuesday February 28, 2023 @03:58PM (#34974736)
>If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient.

Joscha Bach gives a pretty good explanation of the algorithm we follow through the lens of Control Theory, and Stephen Wolfram has a pretty amazing Theory of Everything that explains how it can be arrived at.

Joscha Bach: Nature of Reality, Dreams, and Consciousness https://www.youtube.com/watch?v=rIpUf-Vy2JA

Stephen Wolfram: Complexity and the Fabric of Reality https://www.youtube.com/watch?v=4-SGpEInX_c

Re:'I Worked on Google's AI. My Fears Are Coming True' by barking_biscuit on Tuesday February 28, 2023 @03:49PM (#34974630)
But what about computational irreducibility that arises from complexity?