Re:Using GPT-3 to explain how code works
by machiaweliczny on Monday July 11, 2022 @02:14PM
(#32059664)
There’s no such thing as real language. Language is loseless compression of perception to allow collaboration of agents. NNs also do loseless compression (from already compressed data - words). I think with more raw “senses” their compression will get better. Only missing thing is some memory trick. I would even bet that most humans use heuristic thinking and “logic” is just a way of validating legitimacy of these heuristic proposed patters. Once someone replicates this in AI it will get scary. Already things like “Let’s think step by step” are going in this direction. Hierarchical generation of actions might also help (and model understanding that these actions could be used to cause effects). I agree NNs aren’t enough for RL agents but it’s great bootstrap for world model component of agents that probably somewhere between cat-humanity level
When I say "not a function of" i mean, explicitly, that the model does not have a term which depends on these correlations. Just as F=GMm/r^2 does not have a term for "image pixel weights".
Real Language is what wrote all those books, as much as gravity is what made the night sky. Pixels and word frequencies are symptoms, a few of an infinity of symptoms -- distant effects, whose correlations are not models of their causes.