News for hackers. Stuff that matters.
Re:The Man Who Would Teach Machines to Think by drcode on Thursday October 24, 2013 @10:04AM (#6605278)
Douglas Hofstadter is important because most AI work right now focuses either on (1) big-data-style statistical analysis or (2) emulating brain anatomy.

DH is the most well known guy of a small, stubborn group of AI developers who still believe that "human thought" can be reasoned about and can be understood in isolation, and that we can build intelligence without simply reducing it to statistics or to brain anatomy.

I applaud his efforts, and find some of the programs he's written both creative and refreshing.

Re:The Man Who Would Teach Machines to Think by RogerL on Thursday October 24, 2013 @11:41AM (#6605869)
I'm nobody compared to the quoted people, but I use AI in computer vision, and while I love using Bayesian math for parts of it, I've found no substitute for pragmatically programming in knowledge about the system. Which is different from what the article is talking about; I'm aware. I'm just trying to make a system that works, not understand how the brain works. But I view those as somewhat orthogonal problems ; my computer is structured differently than a human brain, perhaps my algorithms should be different as well. Certainly I see no reason to view the brain as having the best algorithm - perhaps a very non-human brain type of algorithm would be superior. Evolution worked with what it had, and it is unlikely that the result is optimal.
Re:The Man Who Would Teach Machines to Think by jostmey on Thursday October 24, 2013 @11:54AM (#6605940)
I think you are absolutely right. Evolution selected for a form of intelligence that was highly calibrated and biased for operating in the wilderness of Nature. Our minds are not necessary correctly geared for abstract thinking, logic, and rational thought.
Re:The Man Who Would Teach Machines to Think by joshuaeckroth on Thursday October 24, 2013 @10:09AM (#6605304)
Members of what you might call that "stubborn group" have started a yearly conference: Advances in Cognitive Systems. See the top of their FAQ: http://cogsys.org/faq
Re:The Man Who Would Teach Machines to Think by joe_the_user on Thursday October 24, 2013 @10:07PM (#6609367)
Nice group but they are definitely swimming against the currently standard approach.

That said, I think one really interest article here is: "Human-Level Artificial Intelligence Must Be an Extraordinary Science" by Nicholas L. Cassimatis

Brings a lot of challenges into focus.

http://www.cogsys.org/pdf/paper-1-5.pdf

www.cogsys.org

Re:The Man Who Would Teach Machines to Think by jmmcd on Friday October 25, 2013 @04:02AM (#6610334)
Also http://www.agi-conference.org/2013/ which is held in conjunction with IJCAI.
Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @01:33PM (#6606615)
You cannot not reduce it to statistics, vast majority of your cognitive activity is statistical in nature, in the more general sense of the word. The actual high-level structured thoughts are a very thin layer on top of a huge statistical information processing powerhouse.
Re:The Man Who Would Teach Machines to Think by drcode on Thursday October 24, 2013 @03:41PM (#6607420)
Yes, everything can theoretically be reduced to statistics. Next time I build a web app, I'll first design it from the ground up using a Turing machine ticker tape, since all computation can theoretically be reduced to a Turing machine. What's the point of bothering with JavaScript?
Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @05:20PM (#6608059)
You need to use the right level of abstraction for the problem at hand. For modeling intelligence, abstracting away the probabilistic/statistical aspects of cognition greatly limits your options. Continuing the web development analogy, abstracting away statistics in cognitive science is like abstracting away JavaScript/HTML and using WYSIWYG GUI tools. With the same effect of only being applicable in toy problems and not scaling to real world scenarios :)
Re:The Man Who Would Teach Machines to Think by hharrison on Thursday October 24, 2013 @06:18PM (#6608396)
There's a huge middle ground between reducing cognition to statistics (as you seem to be proposing) and "abstracting away" the statistics. You seem to be accusing any approach that's not "statistics all the way down" of ignoring the statistical nature of the mind. When in fact, there are many approaches to cognition which make heavy uses of advances in statistical theory without reducing cognition to statistics.

What you're proposing is an overly reductionist ontology, IMO, and yet I agree that statistics are important, if not critical. (Hint: not the boring linear kind of statistics that you so often see in Big Data)

Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @07:52PM (#6608899)
No I'm not arguing for a statistics-only scheme, just that you can't ignore it / abstract it away, and that its role is crucial in cognition. I think we agree with each other.
Re:The Man Who Would Teach Machines to Think by hharrison on Thursday October 24, 2013 @09:38PM (#6609258)
Well, you said "you cannot not reduce it [AI] to statistics". And I'm saying, not only is it possible to not reduce AI to statistics, it is desirable. It's the reduce part that I have a hard time with.
Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @11:08PM (#6609539)
Possibly poor wording, my intent was to say that you cannot dismiss or underestimate statistics in modeling the mind because the damn thing is a sophisticated statistical information retrieval system (with some higher-level structure on top for doing things like debating mind modeling on HN).
Re:The Man Who Would Teach Machines to Think by gtrak on Thursday October 24, 2013 @09:37PM (#6609250)
What makes the right level of abstraction right? Seems like the units of abstraction have to be amenable to application (analogy), but rightness is fluid. If you have a turing machine, it might make more sense to write a JS compiler first because of the familiarity and perceived difficulty of translating your thoughts, but that's a statistical process of your own head. If you're a fresh mind, you would never create a JS compiler. The aggregated feedback of our social consciousness over time is what sets the 'rightness' of any approach by modulating the difficulty and expressiveness of each concept to each individual.
Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @11:11PM (#6609545)
What makes it right is purely pragmatic and a function of our abilities and limitations, scientific and computational resources, time constraints, etc. We could in theory run quantum simulations for everything, given the resources, but we don't have them.
Re:The Man Who Would Teach Machines to Think by serf on Thursday October 24, 2013 @04:50PM (#6607865)
who cares?

No one is arguing that they've found a domain that statistics can't be applied to or gathered from.

What is implied is that statistics should not be chosen as the preferred main engine of conciousness--because as far as we can tell conciousness is more than just a gestalt voting between the cells of the host it's housed in.

Re:The Man Who Would Teach Machines to Think by upquark on Thursday October 24, 2013 @05:54PM (#6608269)
The issue being discussed is the choice of right level of abstraction and the right tools for modeling a given real-world phenomenon. My comment says that statistics is essential in modeling this particular phenomenon, based on my experience and intuition and that of many experts in the field. Responding with "who cares?" doesn't make sense to me. What part of my statement do you disagree with?
Re:The Man Who Would Teach Machines to Think by serf on Friday October 25, 2013 @12:52AM (#6609828)
I don't disagree with any of it, and I think perhaps my non-chalant "Who cares?" somehow conveyed to you that I think something stated was false. I don't.

But, why waste time with this?

You cannot not reduce it to statistics, vast majority of your cognitive activity is statistical in nature, in the more general sense of the word.

Most here believe statistics are globally applicable, even in domains dealing with the odd, esoteric, or random. With that said..

- Hofstadster tries non-strictly-statistical-methods

- "but you can't be non-statistical!"

- lumps hofstadter into statistical ai > "but hofstadter is non-conformist!"

- create seperate subgroup which hofstadter can exist within with his experiments

- "but you can't be non-statistical!"

... and on and on. Is this the kind of recursion geb was talking about?

A lot of us think we know statistics are universally applicable. It's a waste of time to state, and adds little to the discussion overall. Sorry that it came off so negatively, either before in my first post or now. I don't mean it that way.

Re:The Man Who Would Teach Machines to Think by jokoon on Thursday October 24, 2013 @11:18AM (#6605741)
Is there anything this guy can teach people about intelligence which has nothing to do with computers or neuron networks ?
Re:The Man Who Would Teach Machines to Think by cgh on Thursday October 24, 2013 @11:21AM (#6605761)
Most of GEB doesn't concern either of those things. Why not read it and find out for yourself?
Re:The Man Who Would Teach Machines to Think by giardini on Thursday October 24, 2013 @12:14PM (#6606073)
GEB was a considerable waste of time and contributed nothing to my understanding of intelligence or AI. The time would have been be better spent elsewhere.

If you want to understand Godel's proofs then I recommend the book "Godel's Proof" by Ernest Nagel and James R. Newman:

http://www.amazon.com/Gödels-Proof-Ernest-Nagel/dp/081475837...

Instead of Hofstadter's GEB, read some of his papers, e.g., "Analogy as the Core of Cognition" http://prelectur.stanford.edu/lecturers/hofstadter/analogy.h...

But there are others who have focused longer on analogy, e.g., George Lakoff:

"Metaphors we Live by"

http://www.amazon.com/Metaphors-We-Live-George-Lakoff/dp/022...

"Where Mathematics Come From: How The Embodied Mind Brings Mathematics Into Being":

http://www.amazon.com/Where-Mathematics-Come-Embodied-Brings...

"Women, Fire, and Dangerous Things"

http://www.amazon.com/Women-Fire-Dangerous-Things-Lakoff/dp/...

Re:The Man Who Would Teach Machines to Think by cgh on Thursday October 24, 2013 @06:39PM (#6608517)
GEB's purpose wasn't to provide a comprehensive understanding of Godel's proofs. Nor was it trying to explain AI. It was a very personal book of thinking about thinking, basically. If you aren't a native English speaker then the book might have been less effective.

I own the Nagel and Newman book and probably read it every two years or so.

I also own the FARG book which summarises the work of the Fluid Analogies group. I don't think these papers are as interesting or exhilarating as GEB so I have to disagree with you there.

Re:The Man Who Would Teach Machines to Think by carbocation on Thursday October 24, 2013 @02:07PM (#6606819)
I don't agree with your dismissal of the work, but this is a very constructive comment on the whole with many interesting references and should not have been downvoted.
Re:The Man Who Would Teach Machines to Think by giardini on Thursday October 24, 2013 @02:39PM (#6607057)
I added the references later so that's the cause for down voting.

I didn't really dismiss the book: I read it attentively in it's entirety and, as anyone who has read it knows, that is a big book. But in the end I found nothing new or thought-provoking. Entertaining, yes; enlightening, no. "Where's the beef?" came to mind over and over as I moved through the text.

Hofstadter is certainly bright, has a voluminous memory and can be an entertaining writer but GEB is not IMO a contribution to AI. My expectations were undoubtedly too high.

Re:The Man Who Would Teach Machines to Think by huxley on Thursday October 24, 2013 @11:27AM (#6605797)
Definitely, also worth reading is "Mind's I" which he co-edited --and did commentary-- with Daniel Dennett.
Re:The Man Who Would Teach Machines to Think by ArbitraryLimits on Thursday October 24, 2013 @01:45PM (#6606683)
> Why not read it and find out for yourself?

Because he'll have other things to do in the next year?