Generative AI's Act Two

Re:Generative AI's Act Two by dmd on Wednesday September 20, 2023 @04:12PM (#37589508)

What if I told you I have a machine that takes 1 20k-dimensional vector and turns it into another meaningful 20k-dimensional vector, but the machine is made of a bunch of proteins and fats and liquids and gels? Would you be willing to call it sentient now?

[ Parent | on HN ]

Re:Generative AI's Act Two by buzzscale on Wednesday September 20, 2023 @04:28PM (#37589719)

That's ridiculous. You're asking me to believe in sentient meat?

https://www.mit.edu/people/dpolicar/writing/prose/text/think...

[ Parent | on HN ]

Re:Generative AI's Act Two by RC_ITR on Wednesday September 20, 2023 @04:18PM (#37589601)

Bro, I can't even do 5 dimensional vector math.

EDIT: I couldn't help but make the joke, but I am certain my brain is doing zero dot products as a type this. What these models do is just different.

We should consider what that means, and the 'sentience' jump is just lazy thinking to avoid that.

[ Parent | on HN ]

Re:Generative AI's Act Two by xg15 on Wednesday September 20, 2023 @07:47PM (#37591572)

Sorry to tell you, but your brain is doing millions of dot products - it's what the biochemical reactions in the synapses between neurons amount to. We already know how the brain works on that level, we just don't know how it works on a higher level.

[ Parent | on HN ]

Re:Generative AI's Act Two by RC_ITR on Thursday September 21, 2023 @02:30AM (#37593917)

Sorry to tell you, but neurons do not follow a dot product structure in any way shape or form.

I mean fine I’ll play along - is it whole numbers? Floating points? How many integers? Are we certain that neurons are even deterministic?

The point I’m making is this whole overuse of metaphor (I agree it’s an ok metaphor) belittles both what the brain and these models are doing. I get that we call them perceptrons and neurons, but friend, don’t tell me that a complex chemical system that we don’t understand is “matrix math” because dendrites exist. It’s kind of rude to your own endocrine system tbh.

Transformers and your brain are both extremely impressive and extremely different things.

[ Parent | on HN ]

Re:Generative AI's Act Two by __loam on Wednesday September 20, 2023 @04:55PM (#37590056)

Oh cool, maybe you can explain how the brain works for us then? Since you have such a clear understanding of consciousness.

[ Parent | on HN ]

Re:Generative AI's Act Two by whimsicalism on Wednesday September 20, 2023 @05:00PM (#37590111)

The people seeking to exclude numerical vectors as being possible to be involved in consciousness seem to me to be the ones that you should direct this ire at.

[ Parent | on HN ]