Re:An understanding of AI’s limitations is starting to sink in
by thu2111 on Monday June 15, 2020 @02:11PM
(#23530864)
But at some level our own brains are just very large databases and very good prediction engines, at least when running on auto-pilot and lacking any deep understanding. Hence the phenomenon of BS artists. Sad to say but I've heard speeches that were less coherent and interesting than what GPT-3 produces.
The GPT models are essentially massive databases along with the use of probability models for how words are connected. Do you think that means intelligence? Can it generate new knowledge of things outside its database? Can it generate novel theories for things outside its understanding?
The GPT models often generate streams of text which can found word for word in its database, i.e. it's not really generating anything new as just mimicking. When a parrot repeats a human, it doesn't understand what the words mean, it's just making sounds.