Re:Programmer Salaries in the Age of LLMs
by testtesttesst on Monday January 16, 2023 @10:27PM
(#34408800)
>people misunderstand
and anthropomorphize LLMs
I agree but there is a certain "god of the gaps" process that's happening here.
To me it seems like what's been achieved so far is "encoding" into natural and programming languages. These models can't reason and e.g., can't pass a Turing test. If you play with GPT-3 or ChatGPT enough you can definitely get it to fail on a task a human would succeed at.
When models so far have achieved "reasoning" behavior, usually it's in conjunction with a classical algorithm -- for example AlphaZero used a model to evaluate chess positions but then ran a tree search algorithm to decide what move to play.
I think if LLMs can be combined effectively with some kind of computation process like in AlphaZero or some kind of "chains of thought" [1], then we'll see them do things we'd call reasoning.
Whether to be optimistic or pessimistic about AI depends on the final "gap" -- whether there is an irreplicable/noncomputable/etc. property of human consciousness other than qualia (i.e., if "understanding" is hard). If not humans will become obsolete, so I pray the answer is yes.
I agree but there is a certain "god of the gaps" process that's happening here.
To me it seems like what's been achieved so far is "encoding" into natural and programming languages. These models can't reason and e.g., can't pass a Turing test. If you play with GPT-3 or ChatGPT enough you can definitely get it to fail on a task a human would succeed at.
When models so far have achieved "reasoning" behavior, usually it's in conjunction with a classical algorithm -- for example AlphaZero used a model to evaluate chess positions but then ran a tree search algorithm to decide what move to play.
I think if LLMs can be combined effectively with some kind of computation process like in AlphaZero or some kind of "chains of thought" [1], then we'll see them do things we'd call reasoning.
Whether to be optimistic or pessimistic about AI depends on the final "gap" -- whether there is an irreplicable/noncomputable/etc. property of human consciousness other than qualia (i.e., if "understanding" is hard). If not humans will become obsolete, so I pray the answer is yes.
[1]: https://ai.googleblog.com/2022/05/language-models-perform-re...