News for hackers. Stuff that matters.
Re:Frank Rosenblatt by dang on Friday April 07, 2023 @01:35AM (#35478401)
Related:

Frank Rosenblatt's perceptron paved the way for AI 60 years too soon (2019) - https://news.ycombinator.com/item?id=30236123 - Feb 2022 (57 comments)

Re:Frank Rosenblatt by mikewarot on Friday April 07, 2023 @01:51AM (#35478502)
He wasn't too soon, he was sabotaged by Minsky and Papert[1] who were competitors for funding. His premature death left his ideas in limbo for far too long.

[1] https://en.wikipedia.org/wiki/Perceptrons_(book)

Re:Frank Rosenblatt by ogogmad on Friday April 07, 2023 @05:59AM (#35479959)
In summary, the infamous book "On Perceptrons" was one long strawman: They defined the term "perceptron" far more narrowly than Rosenblatt did, and they expressed vague unsubstantiated pessimism towards multilayer networks, which were Rosenblatt's actual idea.
Re:Frank Rosenblatt by hungryforcodes on Friday April 07, 2023 @08:02AM (#35480703)
This so much !
Re:Frank Rosenblatt by YeGoblynQueenne on Friday April 07, 2023 @09:09AM (#35481198)
Who says this? The wikipedia article you link is very short on citations, but very long on vague invocations of "some critics", without ever citing those "some critics".

Those are all the hallmarks of a rumour of the kind that spread on the internet, based on nothing else than half-digested information and a thirst for controversies. It should be noted that Minsky, himself, was a connectionist who worked on neural networks, as well as other approaches to AI. For example:

https://en.wikipedia.org/wiki/Stochastic_neural_analog_reinf...

I don't think most people who repeat those claims about Perceptrons have even read the book and really know what it says, other than from second- or third-hand sources (i.e. something someone once posted on twitter).

The entire book, in pdf format, can be downloaded from here:

https://ieeexplore.ieee.org/book/8076704

It's a whole book and not a blog post so it takes some reading. Alternatively, there is the introduction to the 1988 reissue with a short foreword by Leon Botu, focusing on the history of the book and its repercussions here:

https://leon.bottou.org/publications/pdf/perceptrons-2017.pd...

And a review of the book with more technical information here:

https://www.sciencedirect.com/science/article/pii/S001999587...

Re:Frank Rosenblatt by ogogmad on Friday April 07, 2023 @10:29AM (#35481928)
Just read the last chapter: The authors appear dead set on a highly theoretical project of proving "learning theorems". They say that they've successfuly proved such theorems for a very weak class of perceptrons. They then insinuate various obstacles to proving such theorems for "Gamba perceptrons" (closer to what people use today in things like GPT) on the grounds of "vacuous generality". But the point they miss, is that the algorithm is more important than the type of automaton, and there's no reason to expect that the capabilities of a learning algorithm can be characterised well by a theorem. The actual direction of Machine Learning has been far more empirical than the one they set out.
Re:Frank Rosenblatt by PeterStuer on Saturday April 08, 2023 @03:16AM (#35491276)
The rivalry and sabotage are well docomented in the book 'The Brain Makers: The History of Artificial Intelligence – Genius, Ego, And Greed In The Quest For Machines That Think' by HP Newquist. A fairly good read even though the author has a very US centric view.
Re:Frank Rosenblatt by bumbledraven on Saturday April 08, 2023 @08:37PM (#35499042)
Fact check: true

Tappert, C. C. (2019). Who Is the Father of Deep Learning? 2019 International Conference on Computational Science and Computational Intelligence (CSCI). doi:10.1109/csci49370.2019.00067 :

> Frank Rosenblatt and Marvin Minsky debated at conferences the value of biologically inspired computation, Rosenblatt arguing that his neural networks could do almost anything and Minsky countering that they could do little. Minsky, wanting to direct government funding away from neural networks and towards his own areas of interest, collaborated with Seymour Papert to publish Perceptrons, where they asserted about perceptrons (page 4), "Most of this writing ... is without scientific value...” Minsky, although well aware that powerful perceptrons have multiple layers and even Rosenblatt's basic feed-forward perceptrons have three layers, defined a perceptron as a two-layer machine that can handle only linearly separable problems and, for example, cannot solve the exclusive-OR problem. The book, unfortunately, stopped government funding in neural networks and precipitated an “AI Winter” that lasted about 15 years. This lack of funding also ended Rosenblatt’s research in neural networks [when he was only 41 years old].

Re:Frank Rosenblatt by com2kid on Friday April 07, 2023 @02:33AM (#35478770)
* * *
Re:Frank Rosenblatt by m463 on Friday April 07, 2023 @04:11AM (#35479403)
I think we ARE nature, organically adapting whatever tool or advantage we find and putting it to use.
Re:Frank Rosenblatt by stareatgoats on Friday April 07, 2023 @05:08AM (#35479719)
> I think we ARE nature

Agree. But will the future autonomous and from humans totally independent AI with self-encoded self-preservation and agency be nature too? I'm inclined to say yes, if we are able to expand our definition of nature just a bit to include non-biological life forms (of which there might be many already, we just haven't noticed).

Re:Frank Rosenblatt by ekkodal on Friday April 07, 2023 @05:55AM (#35479936)
Do you remember the name of the novel? Sounds like a fun read :)
Re:Frank Rosenblatt by jacquesm on Friday April 07, 2023 @07:42AM (#35480579)
I remember reading that and took a 1/2 hour to find it but so far no luck. It may have been a short story. Searching for it is hard because somehow 'Sally' by Asimov keeps popping up but that has nothing to do with it.
Re:Frank Rosenblatt by jumhyn on Friday April 07, 2023 @08:36AM (#35480953)
It’s not quite self-driving cars but Snow Crash has a very similar plot detail.
Re:Frank Rosenblatt by pmoriarty on Friday April 07, 2023 @09:59AM (#35481621)
ChatGPT's answer:

The novel you might be referring to is "Do Androids Dream of Electric Sheep?" by Philip K. Dick. In this novel, there are self-driving cars called "hovercars" that are powered by organic artificial intelligence, including dog brains. The novel has been adapted into the movie "Blade Runner".

Re:Frank Rosenblatt by _a_a_a_ on Friday April 07, 2023 @12:55PM (#35483925)
Is this true that DADOES have this in it, because I've no such recollection (though it was decades ago I read it).
Re:Frank Rosenblatt by com2kid on Friday April 07, 2023 @06:40PM (#35488002)
* * *
Re:Frank Rosenblatt by com2kid on Friday April 07, 2023 @04:40PM (#35486690)
* * *
Re:Frank Rosenblatt by tinus_hn on Friday April 07, 2023 @08:43AM (#35481011)
The original story for The Matrix had the machines use the humans as AI computing devices, not power sources (which doesn’t make a lot of sense). It just turned out too difficult to explain to the viewers.
Re:Frank Rosenblatt by bsaul on Friday April 07, 2023 @09:04AM (#35481164)
it would probably be a good rewrite. machines confronting people to situations and puzzle to solve, train them in specials rooms, then wiring their brains to real-world machines..

I imagine today's people will understand it

Re:Frank Rosenblatt by bee_rider on Friday April 07, 2023 @10:55AM (#35482201)
I really expected the answer to be that humans just screwed up the world too much, the machines were created to help us, and eventually decided the best way to help us did not necessarily require our consent.

They even mention switching the simulation from a sort of garden-of-Eden because people reject too comfortable an environment.

Human brain as a compute device… might make sense as an accelerator for certain communication or approximate spacial reasoning tasks?

Re:Frank Rosenblatt by nextaccountic on Friday April 07, 2023 @11:57AM (#35483057)
This is kind of the reverse of the plot of the Talos Principle
Re:Frank Rosenblatt by version_five on Friday April 07, 2023 @09:22AM (#35481310)
I've often thought (in the sci-fi sense) about the idea of distilling down to the core of what only a brain can do that a turing machine cannot, and then hooking up say a fruit fly brain to perform this "brain" function organically, while the rest is augmented with traditional computation.
Re:Frank Rosenblatt by wwalexander on Friday April 07, 2023 @10:56AM (#35482208)
This was the original concept behind the Matrix, but ‘90s studio execs thought the average person wouldn’t understand and made the humans just be “batteries” instead which makes much less sense.
Re:Frank Rosenblatt by yed on Friday April 07, 2023 @11:48AM (#35482940)
Do you have a reference for this? In interviews I read the Wachowskis defended the whole “batteries” explanation, which lessened my opinion of them.

Edit: found a pretty good reference for it being true: https://scifi.stackexchange.com/questions/19817/was-executiv...

Re:Frank Rosenblatt by nextaccountic on Friday April 07, 2023 @11:56AM (#35483040)
I repeated this in HN too, someone asked for a source and I found out this appears to be false

https://news.ycombinator.com/item?id=35069121

Anyway this will remain in my headcanon, simply because the whole thing makes no sense otherwise

Re:Frank Rosenblatt by bendbro on Friday April 07, 2023 @03:17AM (#35479024)
> transfer of unlearned behavior with brain extracts

I'm surprised that it works.

Re:Frank Rosenblatt by ly3xqhl8g9 on Friday April 07, 2023 @03:48AM (#35479244)
Moths remember what they learned as caterpillars [1]. Memory transfer via RNA injections has also been achieved in snails and flatworms [2] [3].

Memory transfer and memory markets will probably be a thing sometime by 2100, perhaps even synthetic memory markets, let stable diffusion reimagine your past.

[1] "M. sexta larvae can learn to associate odor cues with an aversive stimulus, and this memory persists undiminished across two larval molts, as well as into adulthood. The behavior represents true associative learning, not chemical legacy, and, as far as we know, provides the first definitive demonstration that associative memory survives metamorphosis in Lepidoptera." https://journals.plos.org/plosone/article?id=10.1371/journal...

[2] "Glanzman said one of McConnell’s students, Al Jacobson, demonstrated the transfer of memories between flatworms via RNA injections, coincidentally while an assistant professor at UCLA. The work was published in Nature in 1966 but Jacobson never received tenure, perhaps because of doubts about his findings. The experiment was, however, replicated in rats shortly afterward." https://www.scientificamerican.com/article/memory-transferre... Jacobson's 1966 article, https://pubmed.ncbi.nlm.nih.gov/5921188

[3] Memory in the flesh, https://www.theverge.com/2015/3/18/8225321/memory-research-f...

Re:Frank Rosenblatt by dekhn on Friday April 07, 2023 @11:20AM (#35482496)
Generally memory transfer by mRNA is not considered to be a well-established phenomenon.
Re:Frank Rosenblatt by ly3xqhl8g9 on Friday April 07, 2023 @12:39PM (#35483678)
The snails paper [1] does not mention mRNA, or the RNA type at all. But sure, there are lots to learn and there are more questions than answers.

[1] RNA from Trained Aplysia Can Induce an Epigenetic Engram for Long-Term Sensitization in Untrained Aplysia, https://www.eneuro.org/content/5/3/ENEURO.0038-18.2018

Re:Frank Rosenblatt by stareatgoats on Friday April 07, 2023 @05:21AM (#35479791)
I'm surprised that you got downvoted. Of course it is surprising.
Re:Frank Rosenblatt by bhickey on Friday April 07, 2023 @07:04AM (#35480339)
That's because it doesn't. Take a look at papers citing _The transfer of learned behavior from trained to untrained rats by mean of brain extracts._
Re:Frank Rosenblatt by Yajirobe on Friday April 07, 2023 @03:43AM (#35479200)
How many these so-called ‘fathers of AI/deep learning’ are there??
Re:Frank Rosenblatt by ly3xqhl8g9 on Friday April 07, 2023 @03:54AM (#35479272)
Seppo Linnainmaa, first publisher of "reverse mode of automatic differentiation to efficiently compute the derivative of a differentiable composite function that can be represented as a graph, by recursively applying the chain rule to the building blocks of the function" [1] aka backpropagation. Gerardi Ostrowski was first apparently but didn't publish.

Paul Werbos, "first described the process of training artificial neural networks through backpropagation of errors" [2].

[1] https://en.wikipedia.org/wiki/Seppo_Linnainmaa

[2] https://en.wikipedia.org/wiki/Paul_Werbos

Re:Frank Rosenblatt by mlajtos on Friday April 07, 2023 @08:05AM (#35480724)
Hi Jürgen!
Re:Frank Rosenblatt by seydor on Friday April 07, 2023 @06:16AM (#35480049)
standing on the shouderS of giantS

S for plural

Re:Frank Rosenblatt by jacquesm on Friday April 07, 2023 @07:45AM (#35480591)
Turing and Hinton rate a mention, as do Minsky and Newell. There are probably lots of others, especially given the current explosion of effort in the field.
Re:Frank Rosenblatt by PeterStuer on Friday April 07, 2023 @12:08PM (#35483195)
I'm the lucky owner of a Spartan 1962 edition of Frank Rosenblatt's Principles of Neurodynamics (there was a time University Libraries sold out their inventories for peanuts, and you'd find these pearls amongst the trash).

I still chuckle though at the anecdote in "The Brain Makers" book about the Blatt being used around the AI-Lab as a unit of body odor.

Re:Frank Rosenblatt by _a_a_a_ on Friday April 07, 2023 @01:01PM (#35483988)
> when in 1969 Marvin Minsky and Seymour Papert published the book “Perceptrons” with a mathematical proof about the limitations of two-layer feed-forward perceptrons ... The book's only proven result — that linear functions cannot model non-linear ones — was trivial

A question: IIRC Minsky & Papert proved XOR couldn't be done in that limited perceptron, but that implies (given "that linear functions cannot model non-linear ones") that XOR is non-linear. Is this right, if so how is it not? What does non-linear mean here, actually?

Re:Frank Rosenblatt by AndrewOMartin on Friday April 07, 2023 @04:51PM (#35486808)
Draw a 2d graph, on the vertical axis put A-is-false at the bottom and A-is-true at the top. On the horizontal axis put B-is-false on the left and B-is-true on the right. Now 'fill in' this graph with an X if the combination of A and B is True according to the XOR function, and a O otherwise. You'll find you get similar symbols in opposite corners and can't separate the two groups of symbols by drawing a single straight line.

Now try the same for OR, NOT, AND, NOR and NAND.

Re:Frank Rosenblatt by AndrewOMartin on Friday April 07, 2023 @04:55PM (#35486874)
I think it's worth pointing out that "Perceptions" also says it's trivially obvious that any network with a hidden layer could be used to approximate any curve because then you're basically manually tweaking an arbitrarily complex function. This was significant at the time because no one had published a training algorithm for networks with hidden layers (e.g. backpropogation)