News for hackers. Stuff that matters.
Re:Frank Rosenblatt by dang on Friday April 07, 2023 @01:35AM (#35478401)
Related:

Frank Rosenblatt's perceptron paved the way for AI 60 years too soon (2019) - https://news.ycombinator.com/item?id=30236123 - Feb 2022 (57 comments)

Re:Frank Rosenblatt by mikewarot on Friday April 07, 2023 @01:51AM (#35478502)
He wasn't too soon, he was sabotaged by Minsky and Papert[1] who were competitors for funding. His premature death left his ideas in limbo for far too long.

[1] https://en.wikipedia.org/wiki/Perceptrons_(book)

Re:Frank Rosenblatt by ogogmad on Friday April 07, 2023 @05:59AM (#35479959)
In summary, the infamous book "On Perceptrons" was one long strawman: They defined the term "perceptron" far more narrowly than Rosenblatt did, and they expressed vague unsubstantiated pessimism towards multilayer networks, which were Rosenblatt's actual idea.
Re:Frank Rosenblatt by hungryforcodes on Friday April 07, 2023 @08:02AM (#35480703)
This so much !
Re:Frank Rosenblatt by YeGoblynQueenne on Friday April 07, 2023 @09:09AM (#35481198)
Who says this? The wikipedia article you link is very short on citations, but very long on vague invocations of "some critics", without ever citing those "some critics".

Those are all the hallmarks of a rumour of the kind that spread on the internet, based on nothing else than half-digested information and a thirst for controversies. It should be noted that Minsky, himself, was a connectionist who worked on neural networks, as well as other approaches to AI. For example:

https://en.wikipedia.org/wiki/Stochastic_neural_analog_reinf...

I don't think most people who repeat those claims about Perceptrons have even read the book and really know what it says, other than from second- or third-hand sources (i.e. something someone once posted on twitter).

The entire book, in pdf format, can be downloaded from here:

https://ieeexplore.ieee.org/book/8076704

It's a whole book and not a blog post so it takes some reading. Alternatively, there is the introduction to the 1988 reissue with a short foreword by Leon Botu, focusing on the history of the book and its repercussions here:

https://leon.bottou.org/publications/pdf/perceptrons-2017.pd...

And a review of the book with more technical information here:

https://www.sciencedirect.com/science/article/pii/S001999587...

Re:Frank Rosenblatt by ogogmad on Friday April 07, 2023 @10:29AM (#35481928)
Just read the last chapter: The authors appear dead set on a highly theoretical project of proving "learning theorems". They say that they've successfuly proved such theorems for a very weak class of perceptrons. They then insinuate various obstacles to proving such theorems for "Gamba perceptrons" (closer to what people use today in things like GPT) on the grounds of "vacuous generality". But the point they miss, is that the algorithm is more important than the type of automaton, and there's no reason to expect that the capabilities of a learning algorithm can be characterised well by a theorem. The actual direction of Machine Learning has been far more empirical than the one they set out.
Re:Frank Rosenblatt by PeterStuer on Saturday April 08, 2023 @03:16AM (#35491276)
The rivalry and sabotage are well docomented in the book 'The Brain Makers: The History of Artificial Intelligence – Genius, Ego, And Greed In The Quest For Machines That Think' by HP Newquist. A fairly good read even though the author has a very US centric view.
Re:Frank Rosenblatt by bumbledraven on Saturday April 08, 2023 @08:37PM (#35499042)
Fact check: true

Tappert, C. C. (2019). Who Is the Father of Deep Learning? 2019 International Conference on Computational Science and Computational Intelligence (CSCI). doi:10.1109/csci49370.2019.00067 :

> Frank Rosenblatt and Marvin Minsky debated at conferences the value of biologically inspired computation, Rosenblatt arguing that his neural networks could do almost anything and Minsky countering that they could do little. Minsky, wanting to direct government funding away from neural networks and towards his own areas of interest, collaborated with Seymour Papert to publish Perceptrons, where they asserted about perceptrons (page 4), "Most of this writing ... is without scientific value...” Minsky, although well aware that powerful perceptrons have multiple layers and even Rosenblatt's basic feed-forward perceptrons have three layers, defined a perceptron as a two-layer machine that can handle only linearly separable problems and, for example, cannot solve the exclusive-OR problem. The book, unfortunately, stopped government funding in neural networks and precipitated an “AI Winter” that lasted about 15 years. This lack of funding also ended Rosenblatt’s research in neural networks [when he was only 41 years old].