Re:Natural language benchmarks don’t measure AI models’ gene...
by mrfusion on Sunday August 23, 2020 @08:31PM
(#24256545)
So you’re saying ai needs to be grounded to the real world to be effective?
[ Parent
| on HN ]
Re:Natural language benchmarks don’t measure AI models’ gene...
by ccozan on Monday August 24, 2020 @02:13AM
(#24257931)
Yes. Specifically the way human brain interacts with environment, the same way any AGI will need to sense and react to an environment, the more real the better.
An interesting example would be if the NN learns something from a book, also fed it with the all the critique on that book ( the environment reaction ). So it can possibly learn from a human what is good or bad in that book, etc.
Then both AI and humans can speak the same language ( on terms.of "feeling"/sensing ) and eventually learn the proper context, so less parameters are needed.
Re:Natural language benchmarks don’t measure AI models’ gene...
by mikkom on Monday August 24, 2020 @03:00AM
(#24258131)
> An interesting example would be if the NN learns something from a book, also fed it with the all the critique on that book ( the environment reaction ).
But isn't that exactly what has been done with GPT-3? AFAIK it has been trained with both facts (wikipedia and such) and web-crawled text content that contains both content and critique of content (book reviews, movie reviews etc.)?
Re:Natural language benchmarks don’t measure AI models’ gene...
by ccozan on Monday August 24, 2020 @08:35AM
(#24259990)
I know that, but does the network perceive the critique as environmental reaction? It means if it can distinguish between them.
Putting them in the same basket not sure if it helps.