Re:Institutions try to preserve the problem to which they ar...
by andrewflnr on Saturday February 24, 2024 @08:13PM
(#39496696)
> ...clearly ridiculous if you look at how LLMs work
This is well off topic now, but this doesn't follow at all. LLMs aren't brains and don't even resemble them that closely. LLMs demonstrate that it's possible to learn grammar from scratch, not that humans actually do. I for one think it's pretty plausible that humans have a little bit of neural wetware-acceleration for syntax. In much the same way, it's possible to implement AES with just an ALU and memory operations, but your CPU probably has special hardware anyway.
This is well off topic now, but this doesn't follow at all. LLMs aren't brains and don't even resemble them that closely. LLMs demonstrate that it's possible to learn grammar from scratch, not that humans actually do. I for one think it's pretty plausible that humans have a little bit of neural wetware-acceleration for syntax. In much the same way, it's possible to implement AES with just an ALU and memory operations, but your CPU probably has special hardware anyway.