It's like a 'new form of storage and lookup' as opposed to the kind of 'magic algorithm' we usually think of when we think of AI. Or maybe that's just me.
Inputs -> Outputs not Search -> Response
Like if you train AI on a small dataset, it feels like what it's doing afterwords is a 'function' or 'algorithm' using what is in the end some arcane algebra.
But if you train on all the data in the world, with a trillion parameters ... well ... I kind of feel that 'all the data' is in an AI-style datastructure, that we are 'querying' with AI.
But that's just an observers abstraction.
It's a poor comparison, though, since neurons and synapses aren't the same as parameters in a computational network. It's the same trap that news outlets routinely fall into when citing "storage capacity of the brain" in TBs and other such nonsense.
Can someone describe what the lexical reality of 3.5T inputs actually means?
I feel like this is 'Deep Memorization' instead of 'Deep Learning'.
Like a Doctor who passes everything merely by memorizing the textbook with absolutely no ability beyond that.