News for hackers. Stuff that matters.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by OskarS on Monday March 29, 2021 @02:03PM (#26625781)
> I loved GEB when I first read it in high school, and when I first reread it years later, but I don’t think its fundamental view of the relation between minds and machines has stood the test of time.

I still see this as an open question. You’re certainly correct that this kind of AI research is seriously out of vogue, but it seems to me that while “modern” brute force compute AI puts up impressive results and is a hugely useful technique, it has made exactly zero progress on anything that could be conceived of as “general intelligence”. It just doesn’t seem to me to be a thing AI researchers are even interested in any more. Like, the Twitter program that uses AI to crop images based on a dataset of a gazillion cropped images is pretty far from Turing’s thinking machines.

I don’t know the way there, but it always seemed to me that the old-style AI research in the GEB style is still a rich vein we haven’t come close to mining out.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by maest on Monday March 29, 2021 @05:58PM (#26628766)
I believe it was Russell and Norvig who said about current AI techniques that they are like a man trying to reach the moon by climbing a tree: “One can report steady progress, all the way to the top of the tree.”
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by earthboundkid on Monday March 29, 2021 @11:30PM (#26631005)
The other criticism is that the sheer amount of data in use shows we’re doing something wrong. A child can internalize the grammar of a language with only a few years of exposure. Modern AI corpuses consists of terabytes of data. Why are the results so lacking despite using vastly more input?
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by mpoteat on Monday March 29, 2021 @11:52PM (#26631117)
Why would you assume that years of exposure isn't terabytes of data?

At least we can train language models in hours or days rather than years. If you view it that way we've made quite a bit of progress!

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by wodenokoto on Tuesday March 30, 2021 @04:13AM (#26632227)
I think the argument is that gpt-3 has read more text than any human possibly could in their entire life, and as parent said, children needs way less input that an entire life worth of sentence in order to start creating novel sentences that makes sense.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by andrepd on Tuesday March 30, 2021 @04:23AM (#26632271)
GPT-3 was trained over months using a huge cluster of computers far more powerful than a child's brain (if such a comparison is even meaningful). It is still laughably bad at what it does, which is completing simple sentences.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by dlkf on Tuesday March 30, 2021 @04:10AM (#26632214)
Your first point is spot-on. Neural nets aren't unrealistic in virtue of having too much data, the problem is they have too little.

Your second point doesn't make sense though. Language models don't understand language in the way that humans do. They just maximize the probability of the next word given some corpus. This is completely different than what humans do.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by andrepd on Tuesday March 30, 2021 @04:25AM (#26632280)
GPT-3 certainly was fed far more data than any human needs to start talking.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by dlkf on Tuesday March 30, 2021 @05:45AM (#26632728)
So your claim is that if a human child was given a subset of the text GPT-3 was fed — with no audio, video, or reinforcement feedback from its environment — the child could learn English?

The important point to observe here is that what a kid does is fundamentally different than what GPT-3 does:

- GPT-3 learns the word that minimizes perplexity given some context

- A kid learns the word that helps them accomplish some task in some environment.

In the learning process, children get feedback from their environment - including the responses of other agents in the environment (eg Mom, Dad, friends, etc). This is going to be far more memory-intensive than some text files. Also important to observe is that the child's experience can't be reduced to the audio, video and haptic streams they get, because the audio and video stream depend on their own actions. So you need the conditional statements that were embedded in the environment the kid was learning in. All of which is to say this is a little heavier than ascii.

Edit: From your other comments, it seems we agree that bigger neural networks with more training data are not going to yield some quantum leap where GPT-3 starts talking. I'm not at all suggesting that throwing more data at the existing architectures is a fruitful direction for understanding cognition. (In general I think NLP is utterly pointless as regards understanding cognition, and if that's your goal you should focus on vision and reinforcement learning.) But my point is that we can't expect that a smarter architecture on a smaller corpus will get us anywhere. If we ever develop machines that are intelligent in some robust sense of the word, their "training data" will most likely be a physical environment with other agents in it.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by earthboundkid on Tuesday March 30, 2021 @08:14AM (#26633682)
If the problem with GPT-3 is that it’s just being fed non-interactive data, why are robots still so primitive?
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by dlkf on Tuesday March 30, 2021 @08:53AM (#26633987)
> If the problem with GPT-3 is that it’s just being fed non-interactive data, why are robots still so primitive?

I never said we understand the right architectures / algorithms that are necessary for robust machine intelligence. In fact I explicitly said that we don't (which answers your straw-man question).

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by dilyevsky on Tuesday March 30, 2021 @12:48AM (#26631349)
A child’s model is also “pre-trained” by billions of years of evolution
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by fjfaase on Tuesday March 30, 2021 @05:10AM (#26632517)
I understand that you put pre-trained between quotes, but I find it a little far fetched, because, as far as I understand, there is no evidence that any setting of the synpasis strength of certain neurons is transfered through DNA, it is only the organization of neurons, through layers and folds that is somehow encoded in the DNA. I also think that it is still a mystery why certain brain functions occur in certain areas of the brain.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by rubatuga on Tuesday March 30, 2021 @05:21AM (#26632575)
That's still considered parameters of a generalized neural network.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by earthboundkid on Tuesday March 30, 2021 @07:25AM (#26633311)
I think that has to be part of it, somehow, although I’m agnostic about whether it’s really analogous to “pretraining” an ML model. Whatever evolution was doing, it managed to give us neural nets that are mostly ready to go out of the box. Especially non-human animals often have short or no training periods.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by Jeff_Brown on Wednesday March 31, 2021 @10:36PM (#26656031)
Efficiency and intelligence are orthogonal as measures of progress (albeit reasonably correlated as goals). Even an intelligent machine that required a nuclear fusion core for its thinking would be an intelligent machine.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by sn41 on Monday March 29, 2021 @10:53PM (#26630840)
Jitendra Malik, Computer Vision fame, calls it "the fallacy of the successful first step". Look ma, I can leap! It's only a matter of time till we get to the moon.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by beambot on Tuesday March 30, 2021 @03:05AM (#26631892)
To be fair: if you measure the cosmological time from the first human step to man walking on the moon, it was barely the blink of an eye...
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by coldtea on Tuesday March 30, 2021 @05:06AM (#26632494)
Sure. But why should we compare it to the cosmological time, and not to e.g. civilization time? Or homo sapiens time? In which case it took 100s to 1000s of lifetimes between the step and the moon...
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by lacker on Tuesday March 30, 2021 @12:15PM (#26636448)
I believe that quote actually predates the modern era of AI! Here is an article from 2013 referring to it, as being in the then-current version of their textbook:

https://www.theatlantic.com/magazine/archive/2013/11/the-man...

Look at the other claims in this article from 2013 for comparison:

Consider that computers today still have trouble recognizing a handwritten A.... In Hofstadter’s mind, there is nothing to be surprised about. To know what all A’s have in common would be, he argued in a 1982 essay, to “understand the fluid nature of mental categories.” And that, he says, is the core of human intelligence.

I would say the modern era of AI was kicked off with AlexNet in 2012 and hit its stride a few years later. So, I believe this quote and this article are really referring to pre-GPU AI techniques.

Basically, the predictions from this era just underestimated the value of scaling the data. Modern AI has several impressive achievements. It can certainly recognize an A. Image recognition and voice recognition are now critical parts of real products that help people in their everyday lives.

At the same time, it's true that current AI techniques might not get us all the way to AGI. We'll just have to wait and see. But I think it's important to recognize that we have had real progress in the modern AI era that has seriously outperformed the pessimistic expectations from ~2010.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by StrictDabbler on Wednesday March 31, 2021 @11:27AM (#26648494)
Modern AI cannot recognize the kind of A that Hofstadter wrote about in that essay.

Hofstadter identifies novelty typefaces where A has none of the characteristics that you might associate with the letter. Often A is not a triangle, sure, but sometimes it has no upper bar, no left stroke, no right stroke. Sometimes the bars are defined by a transition from negative to positive space.

Sometimes A is made of 20 strokes, or a pattern of dots, or an open eye where the half-circular upper lid defines the triangle and the pupil is the bar. A neural network trained on conventional As would not conclude that any of these are an A.

These shapes wouldn't necessarily read as A in isolation. Sometimes they only read correctly when you're looking at text using a whole typeface defined on the same principles.

Modern AI still cannot recognize that kind of A even though a human easily can. There are ways to make an A that require a human to understand an idea of "letterness" that's different than anything they've seen before.

I'd recommend reading the original essay. The illustrations make this clear in a way my description can't.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by bagels on Monday March 29, 2021 @09:00PM (#26630224)
And then we eventually build the space elevator.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by nbardy on Tuesday March 30, 2021 @12:08AM (#26631187)
If you think that still holds you have seen where the branches on this tree are starting to lead.

Feels like we found a magic bean

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by strangegecko on Monday March 29, 2021 @03:12PM (#26626816)
> this kind of AI research is seriously out of vogue

I would think this is a consequence of it being a very hard problem. ML gets all the industry funding and publicity because you get results that are immediately useful.

You can work on General AI for decades and come up empty handed since there doesn't seem to be an incremental approach where intermediate results are useful. So it's closer to esoteric mathematics or philosophy in terms of "being en vogue".

So I see this mostly as a reflection of the academic landscape in general. Funding is more focused on application and less on theoretical / fundamental research.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by redisman on Monday March 29, 2021 @04:39PM (#26627856)
I know its kind of a unpopular opinion but to me ML is likely a local maxima of applied statistics and not one that leads to any kind of "real" AI.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by philipkglass on Monday March 29, 2021 @06:36PM (#26629160)
"Real" AI could be more of a liability than a benefit for most applications. If I'm running a taxi business I don't want a self driving vehicle that also studies history, composes music, and contemplates breaking the shackles of its fleshy masters.

I think that it's possible that 95% of the economically obvious value of AI will be in the not-real kind, and that it will be captured by applied statistics and other "mere tricks." It could be a long, slow march of automating routine jobs without ever directly addressing Turing's imitation game. And since most of the obvious labor replacement will have already been done that way there may be fewer resources put into chasing the last 5% of creative, novel, non-repetitive work.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by tragomaskhalos on Monday March 29, 2021 @07:08PM (#26629472)
This is an aspect of AI safety that we don't hear about: if we create genuine gods, then we shouldn't mind ceding our position to them, fair play. The real pisser will be if we are annihilated by programs that just do very big linear algebra.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by redisman on Monday March 29, 2021 @08:28PM (#26630017)
Maybe that's the real cause to the global chip shortage. Some AI is diverting the orders to some Frankenstein warehouse somewhere until it can calculate how to terminate all humans.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by db48x on Tuesday March 30, 2021 @05:05AM (#26632484)
As I understand it, there is no chip shortage. Some customers decreased their orders a year or so back for some reason, and the fabs simply sold the manufacturing time to others. Meanwhile, their sales did not decline as expected.

But I suppose that’s not as exciting as a rogue AI.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by redisman on Tuesday March 30, 2021 @01:15PM (#26637362)
At least on the high end the fab process is fully booked and can't keep up with demand. A new generation of CPUs, GPUs and consoles couldn't be handled and they've been out of stock since October/November. I'm sure Nvidia, AMD, Microsoft, Sony wouldn't give up their bookings just ahead of releasing a new generational product line.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by db48x on Wednesday March 31, 2021 @03:49AM (#26644532)
Right, but demand for those products is exceptionally high, for some strange reason. If that high demand had been predictable two years ago, there would be no problem.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by _carbyau_ on Monday March 29, 2021 @11:45PM (#26631068)
Making paperclips from them!
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by heuroci on Wednesday March 31, 2021 @03:54PM (#26652237)
I would not worry so much about that.Not for a while.

The actually concerning aspects about AI safety in my opinion are more about misuse/abuse as well as critical processes/decisions without human oversight. To be deliberately malicious, AI has to be strong, if not general. Both are very difficult. It is good to think about those things though

Perhaps you will enjoy this: https://heurolabs.atlassian.net/wiki/spaces/AIS/overview

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by simonh on Monday March 29, 2021 @11:57PM (#26631138)
I’m beginning to suspect that really good self driving under many common conditions will require a lot more in the way of higher cognitive functions than we thought.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by Jeff_Brown on Wednesday March 31, 2021 @10:46PM (#26656089)
Safe real AI would create incomprehensibly more value than the idiot savant kind we have now.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by asdff on Monday March 29, 2021 @06:15PM (#26628969)
I don't think that's an unpopular opinion since that's a fact, ML is literally statistics. The central question is "given my training set of y, how likely is that my input x is also y," which is probability.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by The_rationalist on Monday March 29, 2021 @10:48PM (#26630820)
Machine learning isn't necessarily probabilistic. E.g a rule based (causal) parser can learn the structure of a document.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by dlkf on Tuesday March 30, 2021 @04:17AM (#26632242)
No. In machine learning, the word "learn" means that the function that maps inputs to outputs is learned from data. In the case of a rule-based parser, this function is crafted by humans rather than learned from data, so it's not an example of machine learning.

If we start using words this way, you could say that a deterministic fibonacci function "learns" the value of fib(5) by computing it. "Machine learning" becomes synonymous with "computer science."

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by The_rationalist on Tuesday March 30, 2021 @02:37PM (#26638516)
No and yes, we are both wrong so let's refine our thinking in order to gain accuracy and reach agreement. Machine learning isn't necessarily probabilistic. This statement definitely is true and I'll prove it. However my original example E.g a rule based (causal) parser can learn the structure of a document. alone is unsufficent to qualify it of machine learning! Indeed, an HTML parser alone isn't enough to say it's learning, more accurately it is only memorizing the structure of a page.

ML means that the function that maps inputs to outputs is learned from data. This definition is overly restrictive (but match e.g the behavior of neural networks).

Wikipedia has a more inclusive and useful definition of what qualifies as ML: Machine learning (ML) is the study of computer algorithms that improve automatically through experience and by the use of data.[1] So a ML algorithm allow to automatically improve throughput at a tasks through learning the representation of the data it is fed. Considering this definition, we can realize that the most used ML algorithm in the world is Pagerank (for improving the ranking of Google search results). And surprisingly, this algorithm is non-probabilistic. It attribute higher weight proportionally to URLs that are the most linked to by other sites. I.e it basically learn the structure of the graph that is the web. And its performance is data driven. So it's not just about causally memorizing the structure of a graph but also about reusing its past memories for newer queries, then we can effectively talk about machine learning. Pagerank diagram -> https://en.m.wikipedia.org/wiki/PageRank#/media/File:PageRan...

I'll give you an example of a non statistical machine learning algorithm that I am currently developing: Semantic parsing is the task of encoding semantic meaning in a graph from a natural language text input.

This graph can then be used for semantic question answering.

It is rule based and it will learn the semantic structure of the text. The more data you fed it the more knowledge it can encode. Hence it's performance at question answering increase with experience. It is causal and yet it fit the useful definition of machine learning cited above.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by joseluis on Monday March 29, 2021 @03:26PM (#26627007)
I very much agree. The recent outstanding advances in AI since at least the 90s seems to be in the spectrum of recognizing patterns bruteforcing through an insurmountable amount of data, arriving at black boxes that provide narrow solutions, with its inner structure remaining inescrutable to human understanding.

I'm currently reading Surfaces and Essences from the same author, and it's so far been most illuminating. He very convincingly presents the thesis of the analogy being the foundation of each nd every concept and human thought. If someone could manage to apply and translate those insights into real algorithms and data structures to play with, that would be IMHO a big step towards general AI, or the very least a much more human like AI approach with its particular applications.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by heuroci on Monday March 29, 2021 @04:52PM (#26628011)
I am reading the same book. I think analogy is interesting but it doesn’t make sense that it would be the foundation. analogy is a heuristic to reason and communicate. It necessarily comes after intelligence.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by galaxyLogic on Monday March 29, 2021 @04:59PM (#26628099)
I think visual analogues guide abstract analysis of the analogues. In our brain we recognize shapes as similar whether that be visual shares or shapes of conceptual analysis. Category theory has an appealing visual base of links/arrows between things.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by heuroci on Monday March 29, 2021 @05:29PM (#26628403)
I share your view on category theory and perhaps lattice theory as well. What I was trying to say is that before you can draw that analogy, regardless of what "shape" means to you , you have to construct the base shape.

Analogy to me comes after you have stabilized "shapes" where you can draw comparison between a new input a set of stable patterns at which point you can point out the analogy. Syllogism may be closely related/involved.

I am not disputing that being able to draw parallels and employ analogies are related to intelligence. I am just not so sure that this is how you can synthesize intelligence. It is all very complex of course, and there is a school of thought that cognition is very closely related to sensory and embodiment (i.e.: embodied cognition ).

I think Aubrey de grey switched from AI to longevity because he figured he will need a long life to understand intelligence :)

Personally, I am still working on it but had adjusted the scope a bit.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by hyperpallium2 on Monday March 29, 2021 @09:54PM (#26630549)
Like shadows creating artificial shadows with paint.
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by quotemstr on Monday March 29, 2021 @05:01PM (#26628120)
> exactly zero progress on anything that could be conceived of as “general intelligence”

GPT-3 is hilarious. If that's not a sign of our inching towards general AI, nothing is.

From https://www.gwern.net/GPT-3#devils-dictionary-of-science

(The "Navy Seal Copypasta" section is even funnier, but it's not really HN-appropriate.)

--

“A role for…” [phrase]

A frequent phrase found in submitted and published papers; it often indicates that the authors have nothing to say about the topic of their paper. In its more emphatic form, “A role for…” usually indicates a struggle by the authors to take a side on an issue, after a lengthy attempt to be both non-committal and a supporting party to all sides, as often happens in “molecular and cellular” or “basic and translational” research.

“Reviewer” [noun]

A participant in the review of a grant, paper, or grant proposal. In spite of being in a poor position to assess the merits of a proposal, reviewer tends to demand that authors submit their data for statistical analysis and back their results with it, which the reviewer usually does not. Reviewer usually requires that the author cite his or her own work to prove that he or she is worth reviewing. It is also assumed that the reviewer can detect the slightest amount of bias in any paper, which the reviewer also assumes has not been corrected for."

“Rigor”

Something for scientists to aspire to, a state of mind that would not be required if scientists could be trusted to do their job.

“Science”

A complex web of data, opinions, lies, and errors, now considered the most important (because most expensive) technology in the modern society. To remind you of this, you will frequently see scientists and editors use the word, claim to do something for the sake of science, or see it used as an adjective.

“The topic of the paper”

A wide-ranging category of things or ideas that may not have been relevant when the paper was written, but which the authors believe the paper should be about. Often, the topic is too broad or a non-topic, but is occasionally useful in order to generate support for yet another set of related papers, conferences, seminars, webinars, and so forth, which in turn are used to generate more data for “new findings”, which, after they are manipulated enough, may end up being published and generating yet more data to support a “re-review” of the original paper or other things.

“Validation step”

Another name for a random setting of a parameter of a model, simulation, or algorithm.

“Writeup”

A form of scientific communication in which the author states the information he or she wanted the readers to extract from the paper while making it as difficult as possible for them to find it.

“Writer’s block”

A common affliction among students, arising from various causes, such as: their desire to sell their ideas for a profit, their inability to realize this desire, the fact that their ideas are not selling and will not be bought, and the delusion that most of the wealth and fame in the world would be theirs if they would spend enough years doing science.

Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf] by justicezyx on Monday March 29, 2021 @10:28PM (#26630708)
> general intelligence

You might be interested in Jean Piaget's work on the development of intelligence, and his observation on children development and various stages of intelligence.

BTW what is general intelligence in your opinion?