News for hackers. Stuff that matters.
Re:Douglas Hofstadter changes his mind on Deep Learning and ... by disgruntledphd2 on Tuesday July 04, 2023 @10:20AM (#36587076)
Can you share a link to the paper please? I feel like I get you, but would like to disambiguate with the mathematical representation.
Re:Douglas Hofstadter changes his mind on Deep Learning and ... by dlkf on Tuesday July 04, 2023 @10:33AM (#36587263)
I’m not talking about a single paper, I’m talking about a whole research programme. But Rumelhart, Hinton, Williams 1986 is very improtant. A lot of the foundational work is collected in the PDP report.
Re:Douglas Hofstadter changes his mind on Deep Learning and ... by disgruntledphd2 on Tuesday July 04, 2023 @10:48AM (#36587478)
Links would be greatly appreciated. I'm definitely not familiar with NN work from the 80s.
Re:Douglas Hofstadter changes his mind on Deep Learning and ... by disgruntledphd2 on Tuesday July 04, 2023 @10:57AM (#36587555)
> But Rumelhart, Hinton, Williams 1986 is very improtant. A lot of the foundational work is collected in the PDP report.

Thanks!

OK, so this is basically a connectionist model of mind approach?

I can definitely see this as an ancestor of current neural network approaches, and I now have some idea of what you mean by distributed representations.

I mean no disrespect here, but this has not contributed to our understanding of intelligence at all. It's proved useful in getting large datasets to perform certain actions (like vision and speech), but those are not necessarily the same thing at all.

It's a massive, massive advancement in the field of statistics and learning from data, but doesn't seem to map to my conception of intelligence at all.

(as you may have guessed, I'm sceptical that statistical learning approaches will lead to human-level intelligence).

Re:Douglas Hofstadter changes his mind on Deep Learning and ... by dlkf on Tuesday July 04, 2023 @12:45PM (#36589152)
> It's a massive, massive advancement in the field of statistics and learning from data, but doesn't seem to map to my conception of intelligence at all.

You think ”learning from data” has nothing to do with ”intelligence” ?