News for hackers. Stuff that matters.

A comment on An understanding of AI’s limitations is starting to sink in. Parent comment

Re:An understanding of AI’s limitations is starting to sink in by wpietri on Monday June 15, 2020 @12:08PM (#23528926)
Different from what? Regular communication? Because the first involves trying to sync up two minds to have the same idea. The latter involves one mind, trying to generate an idea that ends up being useful. Useful in the George Box sense: "All models are wrong, some models are useful."
[ Parent | on HN ]
Re:An understanding of AI’s limitations is starting to sink in by p1esk on Monday June 15, 2020 @03:28PM (#23531886)
I meant how is knowledge extraction done by a language model different from knowledge extraction done by a human scientist?
[ Parent | on HN ]
Re:An understanding of AI’s limitations is starting to sink in by wpietri on Monday June 15, 2020 @08:34PM (#23534702)
Sorry, I don't understand the question.
[ Parent | on HN ]
Re:An understanding of AI’s limitations is starting to sink in by p1esk on Monday June 15, 2020 @09:06PM (#23534910)
GPT-3 does some form knowledge extraction, right?

You said above: "There's also the kind of meaning that scientists and researchers talk about when they extract knowledge from data."

So if we agree that in both cases some form of knowledge extraction is happening, I wonder how these two forms compare.

[ Parent | on HN ]
Re:An understanding of AI’s limitations is starting to sink in by wpietri on Wednesday June 17, 2020 @07:27PM (#23558061)
A search for "GPT-3 knowledge extraction" doesn't yield much, so I don't know what you're talking about. But as far as I'm concerned, knowledge exists in the heads of people, so I don't think we agree on that.
[ Parent | on HN ]
Re:An understanding of AI’s limitations is starting to sink in by p1esk on Thursday June 18, 2020 @11:31PM (#23570667)
knowledge exists in the heads of people

How is this knowledge encoded in the heads of people? Perhaps through the choice of synapse strength and connectivity between neurons?

What is being encoded in GPT-3 weights as it reads through millions of pages of text? How is it different from tuning biological synapses?

Still don't know what I'm talking about? It's OK, neither do I :)

[ Parent | on HN ]