To me, the resentment is completely understandable. When Watson goes on Jeopardy -- an incredible technical and PR achievement -- the implication to the rest of the world is that ".... and now you can use it too!" The ads, too, convey that idea. But that isn't the case. Instead, I can access APIs for language translation, sentiment analysis, object recognition, etc...
You guys are selling Watson as a new paradigm of AI never before seen by man -- that I can plug my business and my app into this and do things never-before conceived in the history of computing. The service you let me access is basically a bunch of algorithms for which there are countless alternatives -- even in places like Algorithmia. There's a huge disconnect.
Many of the services that are on the platform can do things that were inconceivable just 5 years ago (like having a general visual classifier handle earth imagery with high enough accuracy to be useful http://www.huffingtonpost.com/entry/ibm-watson-california-wa...). Yes, there are alternatives - which is the sign of a healthy market - but we keep improving ours to stay state-of-the-art and to introduce higher level functions.
This should be priority number one. As others ITT have been saying, your marketing and PR departments have been writing checks that the product can't cash.
When people see that Watson can't do what it does on TV, you lose a sale, and that potential customer is now going to be skeptical of IBM's future marketing claims.
It doesn't matter if "answering factoid questions" doesn't have much real-world value — it's first of all what you're marketing the product as, so it should have been done and omigod amazing yesterday, and second of all the reason why your very smart marketing and PR people are pushing that angle is because it's a demonstration that is immediately and intuitively impressive to technical and non-technical people alike.
Getting a computer to "answer factoid questions" viscerally screams "major breakthrough!" in a way that "general visual classification of earth imagery" simply doesn't. It wows people at the sales meeting instead of boring them.
IBM needs to make sales. You need to build up a userbase toot sweet before Google et al start moving into this sector in a major way, as indeed they already are. There's a limited pool of enterprise customers, they don't change vendors often, and you need to get as many as you can as fast as you can, before Google/Amazon/whoever does, or you're done.
"Tout de suite" has never before sounded so appetizing!
[1] https://books.google.com/books?id=FFMADAAAQBAJ&pg=PA80&lpg=P...
It's the common spelling when used in English; I didn't want to seem pretentious. https://en.wiktionary.org/wiki/tout_de_suite#Alternative_for...
Besides, a really good AI should literally be able to sell itself, surely?
This, as a potential Watson customer, would give me a much better idea of Watson's potential and real world results. Plus it would establishes more confidence in IBM.
A lesson from my high school economics teacher that has always stuck with me is that you have to be your own product's biggest believer.
This isn't a matter of PR overhyping things a bit. Watson has (impressive) capabilities, and IBM's ads show Watson doing things, but the two circles essentially don't overlap. IBM is directly marketing Watson to the general public with promises that are entirely unsupported by the actual product. That's not just questionable business advertising, that's a level of inaccuracy that undermines AI work and understanding across the entire field.
Google, Facebook and MS also can't (try using Google translate in any other language combination than English and some other Romance or Germanic language). Why is that a problem for IBM specifically, or why will IBM's overpromising bring about the next AI winder, like Schank says?
Granted, Facebook Graph Search was horribly oversold, and Cortana is in the same "smart enough to be stupid" bucket as Siri and Alexa and every other vaguely-feminine chatbot on the market. Google Translate is incredibly fragile, and will get me from English to French but not from French to Arabic, or even from French to Quebecois.
But all of that is roughly consistent with their advertising. Obscenely selective demos have a long history in software, and it seems standard (though not good) to assume that you're seeing the best-case uses of whatever product is being advertised. Car ads don't work any differently.
Watson's advertising seems to take things to a whole different level. There's that Bob Dylan ad. They've got a North Face ad where Watson recommends an appropriate jacket for the Pacific Northwest in early spring. And so on. The commercial product Watson can't do those things. They aren't just showing off fragile best-case features, they're making stuff up, or hardcoding specific answers, or offering the North Face a different Watson than what you can get on their developer site.
That bothers me. It bothers me when Google claims Translate can live-interpret foreign street signs, too, but even that's a less wild claim than IBM is making. Promising people a product you simply haven't made isn't kosher, and that's especially true when you're selling AI kool-aid, which is a field that's already ripe with hysterical (and baseless) warnings and promises.
Agreed- but I'm saying that that's exactly what I get from ads of the products you mention, Siri, Alexa et al.
Case in point: that real-time Skype translation ad that made the rounds a while ago.
In any case, I don't pay that much attention to what is advertised. But I do pay attention to two things: on the one hand, (scientific) papers published by the various teams and on the other hand, the announcements those teams make in the technology press.
I've read most of the Watson papers and quite a few of the NLP stuff from Google and followed the assorted tech press announcements. I have to say that my impression is that Google is brazenly overhyping their stuff, they constantly try to fudge things as much as they can.
Their dependency parser beats previous efforts on the Brown corpus? It's the best natural language parser ever! Their image recognition beats imagenet? It's showing superhuman ability! And so on. IBM's advertisement is relatively tame in comparison.
All the other major players in this are equally unscrupulous and there's no point in singling anyone out.
I think I was probably put on edge by the Watson ads not just because of their scope (the Skype thing is similarly inaccurate) but because they conform to a very specific pattern of AI over-promising that I've grown to hate.
To a lot of nontechnical (or even just non-CS) people, strong AI is synonymous with Samantha from Her. We've been seeing people mistake existing tech for that since the 60s, when people were taking ELIZA seriously. Cue Cleverbot, Siri, and most obnoxiously Eugene Goostman (you don't get to claim you passed the Turing Test by convincing 30% of English speaking observers that you're a Ukranian child!)
So I look at the Watson ads and see exactly this pattern at work, but worse than ever. Most people know by now that Siri and Alexa are just voice assistants, and as good as the ads look no one is really claiming otherwise. The Watson ads, by contrast, throw around "cognitive computing" to imply real understanding, and then air scripted exchanges that are simply false, rather than selective. Worse, they're doing mass-market ads for a developer-only product, so viewers won't even try it out and see that it doesn't do what's being shown.
It may not be the worst on an overall-inaccuracy level, but I get twitchy when I hear people respond to discussions of strong AI with "Oh, basically what that Watson thing does?" And I do hear that, somewhat regularly. Crappy product hype is annoying, but I really wish we could stop telling people we've built real intelligence when we haven't.
Speech to text: https://developer.ibm.com/watson/blog/2016/04/28/recent-adva...
Emotion: https://developer.ibm.com/watson/blog/2016/02/29/another-ste...
That result makes a lot of sense - Google has been working with the huge corpus of English-European translations (e.g. UN reports) and getting impressive results largely because there's so much data available with such direct equivalences.
Just based on personal experimentation, they're much less capable with longer "translation distances" like phonogram<-->logogram and Indo-European<-->Sino-Tibetan. I didn't know IBM was leading on those long-distance translations, that's cool to hear.
Marketing aside, I must say that BlueMix's user interface is the worst. thing. ever. Buggy, extremely slow, fragmented, with cryptic error messages[1]. Took me 45+ minutes to reactivate my account (the old one was kindly deleted due to inactivity), and create the the TTS/STT services endpoints.
Funny; after all the investment to develop Watson, you'd think UI would be the easiest part to get it right.
On the positive side, the TTS and STT APIs are simply a pleasure to work with. The documentation is excellent, accuracy is pretty good, and the demos are spot on. Plus you have support for streaming audio through WebSocket for STT (which is a must for my project), and a few voices to chose from for TTS.
Thanks for the kind comments on our APIs. We are really trying hard to make them usable.
But I just tested again today, and the slowness is gone, so maybe it was an isolated incident. I was able to play with it a bit more, add services, create a few containers, etc. Definitely an improvement versus the classic interface.
I'm still getting used to the logic grouping and how to access your services (I'm coming from years of AWS / Google Cloud), but the ability to go back-and-forth quickly helps a lot.
Minor nitpick: any reason for API icon to be pink instead of blue, like all others? I keep looking at it as if it were a different state (e.g., "activated").
I work in academic research and learned long ago to ignore any PR related to AI/ML products. The ability to easily play with and test the abilities of Watson services is definitely helpful and enjoyable for us.
Most of my playing with it was focussed on the 'Explore' parts, not the 'Predict'/'Assemble'/'Social Media' functions. I was disappointed in the level of documentation for some stuff (you have to look quite hard to find a definition of 'summary' - on my data, it just sums the column, for example).
I was also disappointed that you can't fit distributions or access the distributions that Watson fits, and at the lack of statistics (you can't get at skewness, kurtosis and so on).
In general Watson's STT is slightly better than competition for long audio (like phone conversations), slightly worse for short utterances (like search queries). That's due to a bias in training set.
Hi. Do you happen to do any work with its parts that are written in Prolog?
I won't argue that the PR goes often too far, and that's a big debate we have internally (I work for Watson). But it's a pity that most of the negative opinions expressed here come from people who haven't even bothered to try any of the services we put out there or read any of the scientific papers that have been published by our team.