News for hackers. Stuff that matters.
Re:Tay – Microsoft A.I. chatbot by hitekker on Wednesday March 23, 2016 @02:29PM (#11347005)
> Tay is an artificial intelligent chat bot developed by Microsoft's Technology and Research and Bing teams to experiment with and conduct research on conversational understanding.

The next A.I. winter will be a very cold one.

For those wondering what I mean exactly: we're seeing the term A.I. being used in marketing, in the papers, in the news. Yes, we are making great strides in weak A.I. but strong A.I.? The kind we read about in stories? The kind of A.I. the public thinks of when we say A.I.? Asimovian Robotics A.I.?

Smoke and mirrors[1]. People develop new techniques and algorithms which are moderately self-learning in a focused way. The general public presumes this to be the basis of a general intelligence which can evolve (magically) to be like another form of life. Soon, everyone jumps on the A.I. bandwagon. The future must just be around the corner!

Then the uncomfortable details emerge; strong A.I. is not a matter of faster processors, more memory, or even more advanced/well-designed programming models. Rather, it is that there is still some fundamental aspect of real, human-like, or even animal-like intelligence that, to this day, eludes our understanding of intelligence.

A.I. winters have occurred many times before in many countries. The United States in the early 80s, for example, was pulling hair over the cybernization of the Soviet Economy. The US highest levels of government gloomily predicted that massive mainframes, given enough information and processing power, would become self-learning and turn the communist laggard economy into a powerhouse.[2]

I think maybe one day A.I. could happen. I think one day I will be proved wrong. Regardless of how A.I. comes about, it will not be due to the label of "A.I." slapped on any kind of product that remotely resembles intelligence. [3]

[1]https://en.wikipedia.org/wiki/AI_winter

[2]http://nautil.us/issue/23/dominoes/how-the-computer-got-its-...

[3] Between the winters, people call their stuff A.I. for the sexiness factor. When called out on the implications of the term, those same people retreat to the textbook definition. "It's A.I!.... well, technically it's weak A.I..."

Re:Tay – Microsoft A.I. chatbot by mikeash on Wednesday March 23, 2016 @04:33PM (#11347985)
Seems to me that there's a big difference now, in that even limited as it is, current AI advances are finding many important practical uses.

For example, automakers are shipping all sorts of fancy driver assistance systems, and a lot of that is driven by fancy image recognition and deep learning systems.

Looking beyond, there's the constantly-discussed self-driving car. It's not here yet, and it's going to take a ton of work, but at this point it looks like there's nothing fundamental standing in the way. It's no longer a question of whether it will happen, but whether it's happening in five, ten, or fifteen years.

Outside of transportation, businesses are applying AI techniques to analytics to squeeze ever more money out of their client base. There's the infamous story about how Target knew a teenage girl was pregnant before her father did. AT&T just sent me a letter saying they're giving me an extra 5GB/month bonus data as long as I keep my plan, which I assume happened because their data indicated I was a risk for downgrading or switching carriers. Improving these systems is worth a ton of money, and as far as I understand it fits really well with where current research advancements are being made.

As long as there are clear, immediate, profitable uses for AI advancements, there shouldn't be any worry of another winter. I guess the question is whether current advancements will peter out eventually, or whether we've reached a point where more research will always produce more immediate dividends. It sure feels like the latter to me, but I could easily be wrong.

Re:Tay – Microsoft A.I. chatbot by colllectorof on Wednesday March 23, 2016 @08:34PM (#11349627)
> Seems to me that there's a big difference now, in that even limited as it is, current AI advances are finding many important practical uses.

Big difference? Do you seriously think that the entire field of artificial intelligence research produced nothing usable until today? For as long as there were AI algorithms there were also attempts to commercialize them (with varying success). The problem wasn't that all of those algorithms turned out to be useless, but rather the mismatch between hype and reality.

You should look into the history of expert systems for a classic example. With things being as they are, deep neural networks might very well go though the same cycle, which is not a good thing for the AI field in the long run.

Caution and skepticism are not the enemies of research and engineering. Hype is.

Re:Tay – Microsoft A.I. chatbot by mikeash on Thursday March 24, 2016 @12:25PM (#11354119)
Of course it produced some usable stuff, but not to the same degree. Take your example of expert systems: as far as I know, they never really took off. There were attempts, and I'm sure there was some commercial success, but it remained a small niche. Compare to deep neural networks today, which are driving sales worth billions and have huge resources from major automakers, and no doubt many others.

Is there a mismatch between the hype and the reality for the people funding this stuff? Certainly there's a mismatch for the general public, but they don't matter.

Re:Tay – Microsoft A.I. chatbot by colllectorof on Saturday March 26, 2016 @02:03PM (#11366655)
> Take your example of expert systems: as far as I know, they never really took off.

This is exactly why I said you should look into their history. They took off big time. Search Amazon for "expert systems" and observe how many books there are about the subject.

They were used by large corporations, hospitals, universities and governments. They were the subject of a lot of research. There were countless startups based around the concept.

Re:Tay – Microsoft A.I. chatbot by colllectorof on Saturday March 26, 2016 @04:07PM (#11367224)
I forgot to mention that in some fields (for example, medical diagnostics) expert systems outperformed human experts. In some fields they are still used today. (They aren't always labeled as "expert system", though.)
Re:Tay – Microsoft A.I. chatbot by fao_ on Wednesday March 23, 2016 @08:10PM (#11349486)
> There's the infamous story about how Target knew a teenage girl was pregnant before her father did.

> AT&T just sent me a letter saying they're giving me an extra 5GB/month bonus data as long as I keep my plan, which I assume happened because their data indicated I was a risk for downgrading or switching carriers.

This isn't Artificial Intelligence though. These seem like they fall under 'Reactive systems' or 'Data Analytics'.

Re:Tay – Microsoft A.I. chatbot by mikeash on Thursday March 24, 2016 @12:27PM (#11354134)
Throughout the history of AI, anything that's developed to the point where it actually works ceases to be "AI."

In any case, it doesn't matter what you call it. Current research is producing results that can improve these systems, which means that research is worth a lot of money.

Re:Tay – Microsoft A.I. chatbot by fao_ on Thursday March 24, 2016 @07:33PM (#11357399)
> anything that's developed to the point where it actually works ceases to be "AI.

Hmm, I've not heard of this happening. Do you have any examples of it?

> In any case, it doesn't matter what you call it. Current research is producing results that can improve these systems, which means that research is worth a lot of money.

I don't see how this really adds to or is relevant to my comment, I was simply restating and adding to hitekker's point that AI is improperly named.

Re:Tay – Microsoft A.I. chatbot by putaside on Wednesday March 23, 2016 @02:59PM (#11347246)
I think this is an unfair assessment. The industry talks of AI, not AGI. It's not Microsoft's fault that the public thinks of Terminator robots when hearing "AI", nor that science-fiction stories have been written a 100 years ago.

The general public does not set budgets for AI research.

AI research benefits from faster processors, more memory and more advanced algorithms. Only philosophers (the domain of AGI is philosophy, not so much engineering or maths) are uncomfortable with those details.

Please refer to AGI, if you are talking of the hypothetical strong AI. The current textbook definition is alright.

(And yeah, the hype around AI is palpable and annoying. That's why many researchers called their work "cognitive science", "machine learning", "optimization", "logic" or "applied maths" and avoided "AI". Because else, they'd have to argue semantics, or defend why they haven't build an artificial God yet...)

Re:Tay – Microsoft A.I. chatbot by romaniv on Wednesday March 23, 2016 @03:34PM (#11347518)
>It's not Microsoft's fault that the public thinks of Terminator robots when hearing "AI"

Large corporation definitely could do better when it comes to explaining the limits of their AI/ML technologies and putting those technologies in perspective (especially historic perspective). Scaling down on hyperbole, buzzwords and personification would help as well.

Re:Tay – Microsoft A.I. chatbot by TheLogothete on Wednesday March 23, 2016 @03:35PM (#11347525)
Why is a glorified calculator considered "AI"?
Re:Tay – Microsoft A.I. chatbot by davmre on Wednesday March 23, 2016 @04:56PM (#11348158)
Why shouldn't it be? You don't even need the glorification. A normal calculator is performing what most people would consider to be a difficult cognitive task, and doing so at a superhuman level.

AI is not some magical ineffable thing that will someday appear out of nowhere. It's the name we give to the gradual progression of our efforts to build machines to perform cognitive tasks. Someone from the pre-computer age would have had no problem recognizing even the ENIAC as intelligent, in a limited sense; it could solve problems that were previously too hard even for the smartest human mathematicians. As someone who actually does AI research on a daily basis, I have no problem with granting intelligence to even very basic chatbots. That goes hand in hand with recognizing that there are many kinds and levels of intelligence, and plenty of opportunity to build smarter and more flexible systems.

Re:Tay – Microsoft A.I. chatbot by TheLogothete on Wednesday March 23, 2016 @05:23PM (#11348376)
You are saying that amebas* are intelligent.

* Viruses would probably be a more apt analogy.

Re:Tay – Microsoft A.I. chatbot by davmre on Wednesday March 23, 2016 @05:32PM (#11348432)
I don't think that follows from what I wrote, though it's certainly a defensible position.
Re:Tay – Microsoft A.I. chatbot by yarou on Wednesday March 23, 2016 @05:03PM (#11348213)
How is anything remotely related to AI a "glorified calculator"?

Pedantically yes, you are taking inputs into a black box and recieving output.

This level of reductionist thinking actually hampers progress in AI, because you're stuck on Chinese room. I mean seriously, they already had this discussion like 20 years ago "fam".

Re:Tay – Microsoft A.I. chatbot by TheLogothete on Wednesday March 23, 2016 @05:25PM (#11348392)
The progress we've made in AI can be summed up by a very nice analogy I recently about Deep Mind beating the Go world champion: "We need to make transistors* and we just discovered fire."

Yeah, you are right. It's some progress.

* For the record, we don't even know if it even possible to make transistors in this hypothetical universe of AI.

Re:Tay – Microsoft A.I. chatbot by Delmania on Wednesday March 23, 2016 @02:34PM (#11347035)
> And then the uncomfortable details emerge: that it's not a matter of faster processors, more memory, or even more advanced programming models: that there is still some fundamental aspect of real, human-like, or even animal-like intelligence that eludes us.

I believe this was answered in GEB. Hofstadter mentions how humans (and some animals) can step out of a system and analyze it objectively. Meaning, we can take the rules of a system, analyze, and determine that we will never be able to generate the desired results. We can objectively lot at things (even ourselves) and reason about them.

A computer, on the other hand, even the most advanced AI, is still just blindly executing the commands given to it.

Re:Tay – Microsoft A.I. chatbot by schoen on Wednesday March 23, 2016 @02:44PM (#11347115)
> I believe this was answered in GEB.

In my reading of GEB, Hofstadter was criticizing other authors who disagreed with his understanding of the Church-Turing thesis (that human intelligence is, or at least is not more powerful than, some kind of rule-following system). Hofstadter thinks that there is no inherent contradiction or essential difference in kind between the human who "can step out of a system" and the computer "just blindly executing the commands given to it".

(But Hofstadter didn't explain at a technical level how to make a computer that's as intelligent as a human being.)

Re:Tay – Microsoft A.I. chatbot by sgt101 on Wednesday March 23, 2016 @05:52PM (#11348565)
I think that's the exact opposite of my reading, I think he flagged that Godel had exactly pointed to why humans and CT machines were different.
Re:Tay – Microsoft A.I. chatbot by NotZachari on Wednesday March 23, 2016 @04:16PM (#11347835)
It all goes back to the theory that it's impossible to implement "unbounded nondeterminism", according to Dijkstra.

As mentioned, humans can step out of a system and analyze it objectively. In essence, the rules can be broken and changed at any time, which means the system is constantly evolving. Logic does not always truly need to play a part, either. The system is constantly changing and adjusting.

Because of this limitation due to our inability to implement systems that are truly nondeterministic, we are forced to use the constantly improving resources (such as faster processors, memory, better algorithms) to improve the speed at which we can mimic this behavior. However, these methods still require the data at hand to function, and several of them lead to exponential growth. As you said, it is always limited to what it's given.

Re:Tay – Microsoft A.I. chatbot by yarou on Wednesday March 23, 2016 @07:52PM (#11349381)
What if you have an agent that can understand not only the rules of a generic game, but the metagame as well? I think that would be a good stab at unbounded nondeterminism.
Re:Tay – Microsoft A.I. chatbot by sklivvz1971 on Wednesday March 23, 2016 @03:06PM (#11347293)
According to GEB, humans have an internal model of their own mind, ergo a conscience. This is what allows them to step out of the system - they can step out of the system within the model.
Re:Tay – Microsoft A.I. chatbot by swombat on Wednesday March 23, 2016 @03:56PM (#11347678)
I'd say the human model of one's own mind is extremely faulty. Bugs in said self-understanding frequently result in conflicts (as we blame everything but our own actions), wars, etc.

Anyone who does any coaching work is intensely aware of these limits (in everyone, btw, the coach included!)...

Re:Tay – Microsoft A.I. chatbot by fao_ on Wednesday March 23, 2016 @08:12PM (#11349500)
Perhaps it could instead be rephrased to 'the ability to build an internal model of their own, and other people's mind'?
Re:Tay – Microsoft A.I. chatbot by sklivvz1971 on Wednesday March 23, 2016 @08:57PM (#11349747)
Yep that goes without saying. The model of something will always be a limited, faulty version for the original.