News for hackers. Stuff that matters.
Re:Meet the algorithm that can learn “everything about anyth... by cyborgx7 on Sunday May 25, 2014 @03:41AM (#7795764)
The problem with all approaches to machine learning I see today is that they only focus on grouping and separating concepts based on certain characteristics. They seem to be all fundamentally statistical.

None of them seem to work towards a fundamental understanding of what the concepts mean. I'm not sure how that could be accomplished though.

Is there even a meaningful distinction to be made between beeing able to identify a concept and understanding what a concept actually means?

Re:Meet the algorithm that can learn “everything about anyth... by gtremper on Sunday May 25, 2014 @04:47AM (#7795847)
This reminds me of one of my favorite Dijkstra quotes. "The question of whether machines can think... is about as relevant as the question of whether submarines can swim"
[deleted]
Re:Meet the algorithm that can learn “everything about anyth... by knome on Sunday May 25, 2014 @08:14AM (#7796158)
Do you happen to natively speak Russian? I've heard that in Russian the word used for people swimming is the same word used for ships sailing.

In English, swimming specifically refers to the motions living organisms use to move in water. Ships instead are said to "sail", even though most do not use sails for power.

Re:Meet the algorithm that can learn “everything about anyth... by baddox on Sunday May 25, 2014 @03:55AM (#7795785)
I don't think there is a meaningful distinction. Do chess computers have a "fundamental understanding" of chess, which humans traditionally considered a benchmark of human intelligence/strategy?

Analogous to the philosophical zombie thought experiment, I think that "real intelligence/understanding" is indistinguishable from simply being able to perform actions to accomplish the same tasks that humans traditionally consider to require intelligence.

Of course, that's one of the PR problems that AI has always had: once a computer can outperform a human at some task, that task is no longer considered to be something that requires "true intelligence." Most people would consider someone who can multiply numbers together to be intelligent, but when computers do that (incomprehensibly faster and more reliably), few people consider even for a moment that it's AI. Same with more advanced mathematics, like computer algebra and automated theorem proving. Same with facial and voice recognition. And I'm sure it will be the same with self-driving cars.

Re:Meet the algorithm that can learn “everything about anyth... by narrator on Sunday May 25, 2014 @09:34AM (#7796281)
The fundamental problem humans will have with strong AI is that it won't be able to properly rationalize it's actions. Sure you'll have a statistical model for why it did what it did but that means about as much to anybody as a numerical reification of the quantum states of every particle of a person's mind at the time they made a decision.
Re:Meet the algorithm that can learn “everything about anyth... by baddox on Sunday May 25, 2014 @02:44PM (#7797121)
When you say "rationalize its actions," are you referring to some mechanism in the inner workings of the brain/software? Or are you just talking about saying things that help humans understand why an action was chosen? I maintain that there is no distinction between the two, and it's quite conceivable that an AI could take an action then say something that helps humans understand why that action was chosen.
Re:Meet the algorithm that can learn “everything about anyth... by Houshalter on Monday May 26, 2014 @03:49PM (#7801264)
If an AI can speak it can tell humans why it did what it did. But it's impossible to look through it's brain and see for yourself. To see if it's telling to truth or exaggerating or rationalizing.
Re:Meet the algorithm that can learn “everything about anyth... by baddox on Monday May 26, 2014 @04:12PM (#7801369)
That's also true of humans.
Re:Meet the algorithm that can learn “everything about anyth... by TuringTest on Sunday May 25, 2014 @12:29PM (#7796709)
Who says they won't be able to? In fact, rationalizing may be the easiest part - the rules of logic are few, and computers are very good at using them fast.

Building new concepts from raw inputs is the difficult part at which humans are better, but now computers are showing that they may be able to do that too.

Re:Meet the algorithm that can learn “everything about anyth... by thret on Sunday May 25, 2014 @05:02AM (#7795872)
If fictional media is anything to go by, the single defining aspect of human intelligence is love. This is the last bastion of human understanding that is incomprehensible to evil, machines and aliens.
Re:Meet the algorithm that can learn “everything about anyth... by herendin on Sunday May 25, 2014 @05:40AM (#7795947)
Humans can already fall in love with computers and virtual personalities, so we're halfway there
Re:Meet the algorithm that can learn “everything about anyth... by baddox on Sunday May 25, 2014 @02:40PM (#7797104)
But love is indistinguishable from a set of actions that we traditionally associate with love, any of which a computer system (especially one connected to a realistic android) could conceivably perform.
Re:Meet the algorithm that can learn “everything about anyth... by aaronem on Sunday May 25, 2014 @11:10AM (#7796499)
Depends on your choice of fictional media; try reading Peter Watts, some time when you're already not in a good mood.
Re:Meet the algorithm that can learn “everything about anyth... by thret on Wednesday May 28, 2014 @01:56AM (#7808592)
Thanks, I'll place Blindsight by Peter Watts in my queue.
Re:Meet the algorithm that can learn “everything about anyth... by aaronem on Wednesday May 28, 2014 @07:12AM (#7809320)
That's the place to start; the Behemoth trilogy isn't bad, per se, but it is a ramshackle thing by comparison, and I think only partly because it has a larger story to tell.
Re:Meet the algorithm that can learn “everything about anyth... by mattmanser on Sunday May 25, 2014 @05:25AM (#7795921)
What do you want?

Until I can just talk to a computer and it always understands what I'm asking, there's no AI is there? It's a fuzzy concept to exactly define, but it's pretty obvious what we all mean when we talk about it.

Brute forcing billions of moves of chess isn't going to achieve that, so it's nothing more than a cute trick that lay people don't understand is a trick so we have to tell them it is.

David Copperfield can "fly" but he can't just fly on demand, he can only fly in very special circumstances in a tightly controlled environment.

He's no more a flying man than deep blue is a thinking computer.

Re:Meet the algorithm that can learn “everything about anyth... by Houshalter on Sunday May 25, 2014 @09:32AM (#7796274)
But that's the thing. We solve a problem and then the solution is just called a "cute trick". The goalpost gets moved further. Natural language processing is getting really advanced. Soon enough you will be able to talk to a computer in a conversation. And then you will just call that a cute trick.
Re:Meet the algorithm that can learn “everything about anyth... by opium_tea on Sunday May 25, 2014 @04:52AM (#7795859)
I'm of the impression that concepts only have fundamental meaning to us because we can relate them to sensory input. For example, initially a child is taught what a boat is by seeing pictures, it eventually learns that boats, cars and bicycles share common characteristics and can be grouped together as vehicles. These common characteristics are all understood and identified by seeing, hearing, touching or smelling.

It would be impossible completely describe a concept such as "horse" to a person with no knowledge of animal physiology, without recourse to pointing at a a horse or impersonating a horse noise. Resorting to analogies with other concepts - "a horse is like a cow" - doesn't work because the person has no knowledge of the other concepts. This person could be a young child or an untrained computer, and they can be taught fundamental meanings of concepts by feeding them information in the form of sights, sounds, smells etc.

I haven't thought about this very deeply but these are the thoughts that always come into my mind when this topic comes up. Concepts have no meaning without relating them to sensory input. Humans learn by connecting the two. Why can the same not be applied to computers?

Re:Meet the algorithm that can learn “everything about anyth... by Houshalter on Sunday May 25, 2014 @09:20AM (#7796250)
There is no question that additional data would be potentially useful to an AI. But it's a common fallacy that it's the only way to get "meaning". Data from a digital camera isn't fundamentally different than data from text. The only benefit is that visual data is far less compressed, more redundant. It's easier to find patterns in it. Natural language is a highly compressed description of things in the real world.

That said, it doesn't at all mean you can't learn anything meaningful from it. For example, you build a machine learning system to predict the missing words in a sentence. "A horse is similar to other farm animals like ____." Machines are getting better at this kind of thing, though still far from human level. Google's word2vec for example can take a word like "horse" and list the words that it is most similar to. You can subtract the representation for "man" from "king", add "woman" and it outputs "queen".

Re:Meet the algorithm that can learn “everything about anyth... by pavpanchekha on Sunday May 25, 2014 @03:53AM (#7795781)
This is in fact a classic criticism of modern AI. Classic approaches tried to replicate human reasoning mechanisms. The work was very cool, but far harder to understand and scale, compared to modern statistical algorithms. To some extent, you are faced with a choice: a small palette of mediocre techniques whose workings are beautiful theories of the human mind; or, a broadly-applicable, incredibly practical set of tools with little motivation or spirit.
Re:Meet the algorithm that can learn “everything about anyth... by PurplePanda on Sunday May 25, 2014 @04:04AM (#7795796)
I understand that other being hard to scale in a machine efficiency sense, the old techniques were also rather limited in applicable domain. They were often based on unjustified models of whatever the author decided was a good model of thought/reasoning, whether "frames", predicate calculus, constraint propagation or whatever. It seems to me that although you say statistical methods have little motivation, the motivation of the alternative - heuristics - is very questionable. Can anyone correct me on this?
Re:Meet the algorithm that can learn “everything about anyth... by pavpanchekha on Sunday May 25, 2014 @02:42PM (#7797110)
That's actually what I meant by scale—that they were slow isn't really a problem if you're interested in AI for the raw fun of it. While justifications for using logic or constraints or probability theory were often lacking from classical techniques, do understand that logic itself was originally developed as a crystallization of proper human thought. And many of the classic AI folks did care deeply about understanding how humans achieved certain results. For example, take a look at Marvin Minsky's work. To the contrary, modern techniques aren't interested in replicating human thought; they are simply interested in replicating human results.
Re:Meet the algorithm that can learn “everything about anyth... by tegeek on Sunday May 25, 2014 @05:31AM (#7795935)
I think one of source of intelligence in humans is "imagination".

IMO "Imagination" itself isn't intelligence but an input to the last "intelligent" activity.

Computers can be taught to exhibit different "intelligent" activities and that is AI & Machine learning is all about.

Human imagination works without any knowledge skill or learning (it is just my understanding, and i might be wrong).

Producing rough and wild-west imagination isn't problem of AI.

Re:Meet the algorithm that can learn “everything about anyth... by pavpanchekha on Sunday May 25, 2014 @02:49PM (#7797132)
Whatever your opinions on what "intelligence" really is and the role of "imagination" in producing it, I can assure you that many computer scientists would like to replicate human creativity, heuristics, and problem solving techniques. Many of the early AI pioneers were as interested in understanding human thought and understanding machine thought (source: conversations with some of them). Modern techniques simply have a different aim.
Re:Meet the algorithm that can learn “everything about anyth... by c0g on Sunday May 25, 2014 @04:38AM (#7795835)
Machine Learning is more of an engineering discipline than a philosophical one. The aim (mostly, with exceptions) is to make machines that learn, not to research the nature of "understanding" or "concepts".

There are people who are looking at broader ideas of "what is intelligence", sometimes even the same people doing the more statistical research, but it's an open ended problem.

The main reason science/math/statistics doesn't spend time worrying about philosophy is because you can't really specify the problem cleanly - and having a clear idea of the problem is 90% of the way to finding the solution.

[edit]: If you want brain-inspired ML stuff, it's worth looking at what neuroscientists and cognitive scientists are doing. From what I've seen of some of their work they're developing ML algos as minimal tests for understanding how parts of the brain or consciousness works.

Re:Meet the algorithm that can learn “everything about anyth... by PurplePanda on Sunday May 25, 2014 @03:57AM (#7795787)
I don't think that anyone can answer that categorically. It's a question for philosophy or metaphysics. Almost merely a matter of opinion. It's hard to criticize software for not working towards a "fundamental understanding of what the concepts mean" if we admit that we don't really even agree on whether that is a valid sentence or what it might mean.
Re:Meet the algorithm that can learn “everything about anyth... by goblin89 on Sunday May 25, 2014 @04:54AM (#7795861)
> Is there even a meaningful distinction to be made between beeing able to identify a concept and understanding what a concept actually means?

How would you define “understanding” and “actually means” in your question?

See also: http://en.wikipedia.org/wiki/Chinese_room

Re:Meet the algorithm that can learn “everything about anyth... by hyp0 on Sunday May 25, 2014 @07:03AM (#7796066)
have you seen chomsky and norvig's debate on this? http://norvig.com/chomsky.html