Re:Turing-NLG: A 17B-parameter language model
by okigan on Monday February 10, 2020 @03:03PM
(#22292666)
any books/papers that address "goal" oriented NLP or hybrid based discussion?
[ Parent
| on HN ]
Re:Turing-NLG: A 17B-parameter language model
by ctoth on Monday February 10, 2020 @03:54PM
(#22293186)
There's interesting research out of Deepmind on two parts of this, which are using the Transformer model in Reinforcement Learning contexts[0] and creating textual GANs[1].
As you are probably aware, GANs are one of the important tools that have driven forward image synthesis and until recently it was impossible to apply them to text, so I expect this to push us quite a bit forward. There's also ongoing work in the selection of the metric to use to evaluate the generated text, and discriminate between human and machine-generated text.
Re:Turing-NLG: A 17B-parameter language model
by jandrese on Monday February 10, 2020 @03:10PM
(#22292721)
The ability to set your own goals and task yourself to achieve them is the essence of AI. Not "AI" as we know it today, but Sci-fi AI where it's a machine person.
Re:Turing-NLG: A 17B-parameter language model
by joe_the_user on Monday February 10, 2020 @04:38PM
(#22293670)
Indeed, but that kind of describes the gulf between current language processing and present AI. Present AI generates tokens that seem to have meaning or seem like an appropriate response to a statement but where it become evident after 2-3 paragraphs, there's no substantial relation to either underlying meaning or underlying goals.
Part of this is "underlying meaning" is an intuitive way to describe things but whatever is underlying here is more tenuous than a classical logic/GOFAI model of the world but more "solid" than a long, clever stream of associations.
Re:Turing-NLG: A 17B-parameter language model
by okigan on Monday February 10, 2020 @05:41PM
(#22294204)
If one interprets that "set you own goals" is the task of AI then it's probably Sci-Fi AI, but that wasn't my question.
Let's say we have a goal, "evaluate persons impression of a particular book/topic/etc".
So the goal would be to have a conversation on this and related topics that would (re)construct person's impression.
Hence my question if there are any publications/articles that explored that?