> Meanwhile, transformers do learn things
That's the question though, do they? One way of looking at gen AI is as a highly efficient compression and search. WinRAR doesn't learn, neither does Google - regardless of the volume of input data. Just because the process of feeding more data into gen AI is named "learning" doesn't mean that it's the same process that our brains undergo.
To the extent that we know what learning is (not very!) yes they do.
Re:
by ghostzilla on Thursday June 20, 2024 @09:30AM
(#40738577)
Or a pebble; for a super intelligent pebble.
“God sleeps in the rock, dreams in the plant, stirs in the animal, and awakens in man.” ― Ibn Arabi
(Why spend a mouse? Just sit a strawberry in a library, and if the hypothesis holds that the quantity of data is the only thing that matters holds, you'll have a super intelligent strawberry)