Re:Language is not essential for the cognitive processes tha...
by winwang on Sunday October 20, 2024 @06:18PM
(#41898955)
I mean, the QKV part of transformers is like an "ASIC" ... well, for an (approximate) lookup table.
(also important to note that NNs/LLMs operate on... abstract vectors, not "language" -- not relevant as a response to your post though).
ultimately, there's no reason that a general algorithm couldn't do the job of a specific one, just less efficiently.