Building Transformers from Neurons and Astrocytes

Re:Building Transformers from Neurons and Astrocytes by dontreact on Sunday October 23, 2022 @11:24PM (#33312661)

It seems like almost no matter what the AI folks come up with, there will be some potential way of interpreting neural phenomena as loosely mapping onto it.

[ Parent | on HN ]

Re:Building Transformers from Neurons and Astrocytes by puttycat on Monday October 24, 2022 @12:25AM (#33312927)

This. Thank you

[ Parent | on HN ]

Re:Building Transformers from Neurons and Astrocytes by mjburgess on Monday October 24, 2022 @03:33AM (#33313894)

They came up with the function,

    f(x; W, W', ...) = ...max(0, W''max(0, W'max(0, Wx)))

And called it a "neural network"

When your opening gambit is that ridiculous, you really can't expect them to improve. We're not dealing with people interested in science in the ordinary sense.

[ Parent | on HN ]