Re:LLMs trained on “A is B” fail to learn “B is A”
by spicyusername on Wednesday September 27, 2023 @07:34AM
(#37673175)
if there is more to human intelligence, what do you think it is
Thousands of dedicated scientists have spent their entire careers trying to answer this question and we still don't have something remotely approximating an answer. If the answer to "what is consciousness" was as simple as some groups of linear algebra equations, I think someone would have figure that out by now.
A gut feeling that one thing is kind of analogous to another is just that.
A carpenter and a woodpecker both bang on wood, but knowing anything at all about one doesn't really tell you anything about the other.
I suspect laypeople would be less likely to try to make the connection between LLM graphs and physical neurons, if they wouldn't have called those groups of equations "neural networks".
A gut feeling that one thing is kind of analogous to another is just that.
A carpenter and a woodpecker both bang on wood, but knowing anything at all about one doesn't really tell you anything about the other.
I suspect laypeople would be less likely to try to make the connection between LLM graphs and physical neurons, if they wouldn't have called those groups of equations "neural networks".
They share the name, but not much else.