News for hackers. Stuff that matters.
Re:Chatbots have struggled to live up to the hype by jklinger410 on Sunday April 02, 2017 @02:30PM (#14018299)
The developers of RPGs like Morrowind would be better suited at building chatbots than the companies currently trying, I think.

Much like the examples in this article, I haven't seen any bots that can present information in a way that is easier than a normal interface, or that even counts as "conversational."

Maybe I'm being an asshole when I say this, but it just doesn't feel like these chatbot companies have put in the sheer man-hours to work out conversations. They're feeding you the information they have, through a small number of prompts that they predetermine. 100% useless.

Where are the creators of Cleverbot? Shouldn't they be using their platform to capitalize on this? That was the most conversational bot I'd seen so far and it came out forever ago.

Re:Chatbots have struggled to live up to the hype by WalterSear on Sunday April 02, 2017 @03:29PM (#14018560)
Having worked developing conversational interfaces for the last six months, I concur entirely.

The wrong people are doing the wrong job, too fast and without any forethought, to capitalize on the tech news hype cycle more than anything else.

Re:Chatbots have struggled to live up to the hype by jacinabox on Sunday April 02, 2017 @04:58PM (#14019007)
I saw a recent article try to claim that conversational UIs were just like GUIs -- there are a handful of buttons, that you need to shoehorn into verbal commands.
Re:Chatbots have struggled to live up to the hype by WalterSear on Sunday April 02, 2017 @05:48PM (#14019231)
That's what many people are trying to do, and why they are such a maudlin medium so far. IMHO, most are trying to shoehorn their UI into chat for no good reason.

Conversational UIs are good for two things really - dealing with massively selection, and providing an interface for entirely naive users.

Ultimately, I see them as much an extension of search interfaces as they are of messenger apps, insofar as given a potentially open-ended number of buttons (like restaurants in your area) it's easier to ask for them in english, despite the fact that the interface has anticipate all the issues that brings (you might not get it right, your request may be ambiguous etc)

And, sometimes it's easier to use english to make a selection - particularly if you don't know how to do something that should be relatively simple, and is consequently relatively simple to describe in english ("Hotel room, turn on the lights." "I want to order a pizza."). Unfortunately, this takes both advanced natural language parsing, and equally advanced response generation. The later is much harder, and I feel generally neglected, by most chatbots and platforms, IMHO.

This makes a lot more sense when using voice rather than text, but ultimately, hybrid voice/gui chat displays are what chatbots are going to evolve to. You will ask for something via voice and in addition to receiving audio responses, you will receive a stream of UI widgets in a chat window containing supplemental information and finer grained controls, such as sliders for the color/brightness of your hotel room light, or an options menu for your pizza order.

Amazon Alexa and Google Now are already quietly doing this, for the most part, but it's going to become a much prominent part of the interaction over time.

Re:Chatbots have struggled to live up to the hype by wale on Monday April 03, 2017 @09:12AM (#14022466)
Spot on. Just spot on. I do share this thought
Re:Chatbots have struggled to live up to the hype by jacquesm on Sunday April 02, 2017 @05:44PM (#14019197)
I built a super simple system a while ago that simply kept up the conversation as long as it was 'on track', the first time it would deviate it would engage a human on the back-end and record the answer extending the track just a little bit further.

After a couple of months of training it it could keep up a conversation for a few minutes along most of the tracks that it had learned. To make it look more life-like I added random delays in answering and sometimes splitting an answer across two messages. Spelling errors were retained as well instead of being corrected.

Of course that's not a 'bot', merely a recorder and replay but it was at least as effective as long as the conversation was kept relatively short.

Re:Chatbots have struggled to live up to the hype by lowglow on Sunday April 02, 2017 @06:59PM (#14019515)
"Human on the back-end" is called "Human in the loop" for anyone looking into this.

https://en.wikipedia.org/wiki/Human-in-the-loop

Re:Chatbots have struggled to live up to the hype by chillacy on Sunday April 02, 2017 @02:41PM (#14018347)
I think you're right that chatbots need to be way more conversational, but I don't think having every company re-implement Cleverbot would be beneficial. Certainly Siri does this, but that gets old after awhile, and it's annoying when siri thinks you're looking for a joke or something clever when you just want information. I think the parallel to real life is when you call customer support, or order food at Wendy's. The conversation is usually extremely railroaded towards one specific subject (though within that domain, you can dive deep, like "are the pickles super sour or are they more like fresh pickles" that chatbots can't do yet)
Re:Chatbots have struggled to live up to the hype by eru on Sunday April 02, 2017 @04:28PM (#14018879)
I think that's why Google's Assistant explicity went for "no personality, no banter".
Re:Chatbots have struggled to live up to the hype by jklinger410 on Sunday April 02, 2017 @03:23PM (#14018529)
I definitely agree with you on this. I think somewhere in the middle-ground is perfect, obviously.

I think I should be able to ask your chatbot how their day is going, but I don't think I should be able to shitpost with it for 3 hours.

The reason I bring up Chatbot is because they seemed to at least have the conversational part figured out.

Also, Siri is really not such a part of this conversation because it is honestly the only chatbot that I can think of that accomplishes a portion of what we're talking about here.

Re:Chatbots have struggled to live up to the hype by behnamoh on Sunday April 02, 2017 @04:56PM (#14019004)
Siri can't even tell jokes, while Cortana is capable of telling jokes, singing, and much more.

These little things - even though programmed by some other person - can spice things up and make the bot look even more natural.

Go home Siri.

Re:Chatbots have struggled to live up to the hype by PhasmaFelis on Sunday April 02, 2017 @06:18PM (#14019376)
Cortana's novelty functions are cute and make good advertising, but they're not really relevant to the quality of the service. In practice, you'll use them a couple of times, chuckle, and then never think about them again.
Re:Chatbots have struggled to live up to the hype by eginhard on Sunday April 02, 2017 @05:46PM (#14019213)
The other day, (French) Siri replied to "What are you doing this evening?" with "I'm playing hide-and-seek with Markov models".
Re:Chatbots have struggled to live up to the hype by Kurtz79 on Monday April 03, 2017 @07:24AM (#14021981)
When I set a short timer the answer sometimes is something like:

"Make sure you don't overcook that egg" or

"The suspense is killing me".

Re:Chatbots have struggled to live up to the hype by jsemrau on Sunday April 02, 2017 @09:17PM (#14020004)
This would have been a perfect example for the event domain I proposed to Apple. But they don't want it.
Re:Chatbots have struggled to live up to the hype by jsemrau on Sunday April 02, 2017 @07:06PM (#14019549)
I never found a use case when Siri actually worked.

Failed cases : 1. Lookup Wikipedia during an amazing race 2. Play a specific song 3. Find an event in my calendar

Re:Chatbots have struggled to live up to the hype by throwaway729 on Sunday April 02, 2017 @08:39PM (#14019884)
2 works for me on Google's voice assistant. Setting alarms, getting directions, and voice dialing also work well. Nothing too exciting. Mostly useful when you don't have hands/eyes or don't want to get up and reach your phone. "Clap on/clap off" lights type of thing.
Re:Chatbots have struggled to live up to the hype by jsemrau on Sunday April 02, 2017 @08:52PM (#14019923)
How is Google VA with background noise. I will renew my phone soon and am between the Pixel and the iPhone 7 (but I hate the absence of the headphone jack and don't want an adapter)
Re:Chatbots have struggled to live up to the hype by throwaway729 on Sunday April 02, 2017 @09:27PM (#14020036)
Hard to quantify. Some specific scenarios:

- It won't work in a loud bar

- It will almost always work in a car where you're the driver and there's a backseat conversation or the radio is on.

- It's fine with street/sidewalk noise.

- Not-terribly-loud coffee shops, stores, etc. are also usually just fine.

Re:Chatbots have struggled to live up to the hype by RugnirViking on Tuesday April 04, 2017 @10:10AM (#14032738)
An anecdote: is that recently I was in a noisy restaurant with an open kitchen (think loud steam blasts and fryers and servers yelling out order numbers) and showing an older friend how far voice recognition had come and it successfully got most of our queries first try and if not, every time second try. This is with English language and asking it to play specific songs. We also have something of a strong accent compared to the san-fran types that presumably trained it (northern England)
Re:Chatbots have struggled to live up to the hype by behnamoh on Sunday April 02, 2017 @05:03PM (#14019040)
Nowadays all those companies are reinventing the wheel: They make virtual assistants like Siri, Cortana, and Google Assistant. But really, they all do relatively the same things. These companies are just creating applied AI mainly for marketing and commercial reasons.

That's not how we'll be able to achieve real AI soon.

Re:Chatbots have struggled to live up to the hype by jonathankoren on Sunday April 02, 2017 @06:16PM (#14019367)
I sincerely doubt a gaming company would bring anything to the table. Simply because, no one wants an phone tree, and that's what games provide.

The reason why 90% of chatbot companies aren't living up to the hype is because they're doing it wrong. Either it's an phone tree, or they're doing naive matching on regexps, or perhaps just throwing a bunch of data and trying to deep learn some intents. It's pretty amateurish. If you used more traditional NLP techniques, you'd get much further.

The other problem with chatbots is that people have become accustomed to general chatbots like Siri, and so even if you say, "my chatbot only does X", you're still going to have people trying all sorts if stuff that's not X. ("Hey, banking bot! What's the melting point of lead?" "I only do banking question." "You suck banking bot.")

Re:Chatbots have struggled to live up to the hype by tomtheelder on Tuesday April 04, 2017 @12:23PM (#14034388)
I don't think this is true, I think you are just overestimating the abilities of even the most advanced chatbot technologies. You get presented with a traditional conversation interface and you are expecting the level of communication you would get with an actual person, but all current consumer chatbots (including Siri/Google Assistant/etc.) fall horribly short in offering a seamless, fluid conversation. The result is a really unpleasant experience made worse by high expectations.

We are just way, way off technologically.

Re:Chatbots have struggled to live up to the hype by themagician on Sunday April 02, 2017 @02:45PM (#14018372)
They end up just being command line interfaces at the end of the day.
Re:Chatbots have struggled to live up to the hype by WalterSear on Sunday April 02, 2017 @05:57PM (#14019271)
That's what they should be: command line interfaces for people who don't use computers.
Re:Chatbots have struggled to live up to the hype by jsemrau on Sunday April 02, 2017 @07:07PM (#14019551)
I never thought about it in this way, but you are right.
Re:Chatbots have struggled to live up to the hype by make3 on Sunday April 02, 2017 @04:13PM (#14018811)
Cleverbot is really just a gimmick, it's an empty toy
Re:Chatbots have struggled to live up to the hype by WorldMaker on Monday April 03, 2017 @12:59PM (#14024589)
I still think that the Jack Principles is one of the most useful UX documents in this arena and that it is a shame that it's gotten so hard to find.

Originally designed for and lessons from the game company formerly known as Jellyvision (the game company part of that is now spun off into Jackbox Games), the Jack Principles was a briefly free resource during the late part of the IRC chat bot golden age in the 90s.

The consulting firm that is left at Jellyvision still uses it as a part of their consulting, so they don't give copies away for free anymore. I'd love to see a new edition of the Jack Principles in textbook form, especially now that it is very relevant again.

Re:Chatbots have struggled to live up to the hype by 0x445442 on Sunday April 02, 2017 @02:39PM (#14018330)
>> Much like the examples in this article, I haven't seen any bots that can present information in a way that is easier than a normal interface...

Funny, I see the interface of bots on a messaging platform as their only value. As for the AI/NLP, Meh. To me the possibility of replacing the umpteen apps and Web pages with a single consistent UI is the appealing part.

Re:Chatbots have struggled to live up to the hype by dxhdr on Sunday April 02, 2017 @02:43PM (#14018356)
What's the consistent interface of bots? You need to know their supported commands to get anything done. Until we have actual AI it will remain an obfuscated command line. Interfaces like Siri are convenient because they actually use AI/NLP!

In many ways this new generation of chatbot is worse than what we had 20 years ago in IRC -- at least then the functionality was clearly presented.

Re:Chatbots have struggled to live up to the hype by andybak on Sunday April 02, 2017 @03:27PM (#14018546)
> Until we have actual AI it will remain an obfuscated command line

Well put, sir. I hadn't managed to put that into words quite as succinctly but you've pinpointed exactly my feelings and my reasons for skepticism.

Unless you bother to read up on the commands that it accepts you find yourself greeted 50% of the time with "I don't know how to do that". Now we're on the same turf as any good UX problem - power-users (who have the incentive to learn an interface) vs casual users (who don't and shouldn't have to). Chat bots seem to be targeting the latter but they require the time investment of the former.

Re:Chatbots have struggled to live up to the hype by 0x445442 on Sunday April 02, 2017 @02:51PM (#14018396)
Yeah, I was speaking from a slanted point of view because I'm not the typical user. What interests me about them is their potential to be a more powerful terminal command line. One that can render graphical responses as well as text.

I've grown very tired of all the differing UIS I must navigate on a daily basis.

Re:Chatbots have struggled to live up to the hype by PhasmaFelis on Sunday April 02, 2017 @06:25PM (#14019409)
> Until we have actual AI it will remain an obfuscated command line.

I've never met a command line that wasn't obfuscated. Try learning Unix using only man pages as reference. With bots, you can at least expect reasonable responses to some natural-language requests.