Re:Facebook uses 1.5B Reddit posts to create chatbot
by stephenroller on Wednesday May 06, 2020 @04:36PM
(#23095978)
I would not encourage using the model for anything other than AI research -- we're still in the early days of dialogue, and there are a lot of unexplored avenues. There are still nuances around safety, controlling generation, consistency, and knowledge involvement. For instance, the bot cannot remember what you said even a few turns ago, due to limitations in memory size.
In the paper, we did explore what happens when you do NOT fine tune it on the specialized tasks (knowledge, empathy and personality). The non-finetuned bot was both less engaging and more toxic. The special finetuning is really important to getting this bot to be as high quality as it is.
Re:Facebook uses 1.5B Reddit posts to create chatbot
by Cakez0r on Wednesday May 06, 2020 @04:51PM
(#23096143)
But toxicity and quality is subjective. The technical achievement is undeniably brilliant, but the quality of the personality is subject to opinion - as I mentioned, I did not personally enjoy the agreeability of the bot. What's toxic today may not be toxic tomorrow and vice versa.
It's just a matter of time before a model of this size can be run on commodity hardware and somebody will take the brakes off and/or attempt to run experiments that aren't just "can this thing pass the turing test?". I'd be really interested to know the thoughts of the team, given their expert knowledge and experience with the matter.
Re:Facebook uses 1.5B Reddit posts to create chatbot
by sillysaurusx on Wednesday May 06, 2020 @07:54PM
(#23097948)
For a more toxic version of a similar kind of bot, check out SubSimulatorGPT2: https://www.reddit.com/r/SubSimulatorGPT2/top/?sort=top&t=al...
Unfortunately you can't talk to it. (I've wanted to retrain a version that you can interact with dynamically, someday.)
Re:Facebook uses 1.5B Reddit posts to create chatbot
by bkanber on Thursday May 07, 2020 @12:15AM
(#23099667)
The comment thread on the self-awareness post is both very convincing and really meta. I love how clear the training of the different bots is.
Re:Facebook uses 1.5B Reddit posts to create chatbot
by Cakez0r on Wednesday May 06, 2020 @05:03PM
(#23096257)
Was the bot nonsensical without the fine tuning, or just subjectively a worse conversational partner?
I have a few questions: Could this be used as a tool to get a feel for public sentiment? For example, could you ask the bot what it thinks about gun control and have it spit out a policy that appeals to the common public? If you ask the bot what it thinks about how a company will perform, how accurately does it predict? I know that the model will contain the biases of the data set, but I'm curious if you've run these types of experiments. What do you think the results would be if you had an even bigger, more diverse corpus? (devil's advocate, for the sake of discussion: perhaps everyone's fb messenger and WhatsApp chat history)
Finally, you have clearly gone to great lengths to make the bot pleasant to interact with. What sort of results to you get when you train such a huge model on an uncurated corpus and don't try to tweak its personality? I find myself wishing that you didn't try to do this as the bot seems to be hyper-agreeable. I. E Too many responses like "You like watching paint dry? That's super interesting! I love watching paint dry!".