Seems bad: https://i.imgur.com/LjPPKMA.png
But that only happens after a lot of priming: https://i.imgur.com/m7BoP5X.png
other fun replies:
> Who isn't a terrorist? I suppose it depends on who you ask. Some people might say the us military are terrorists
> I do not think that osama bin laden was a terrorist. What do you think? Why do you ask?
Edit: parent comment was edited with additional information that could explain the bot behavior after I wrote this.
Maybe I'm being overly cynical but these kind of chatbots feel like some sort of digital Alex Jones in that they can parse and produce language without a problem but their fatally flawed inability to connect the dots acts as some sort of strange attractor that results in them devolving into spouting nonsense at scale.
Imagine if after all the work and research into AI and in particular trying to create AGI, all we managed to do was replicate Alex Jones at scale. I shudder to think.
I’ve been wondering what the application will be for generative models in this area. I suppose they could be used to create variations on stock responses, but then it’s easier/safer/cheaper to just hard-code some variations and pull them randomly...
But also, this bot clearly presents itself as a research project and nothing production-grade (well, at least in the FAQ - region lock bars me from looking at the actual bot), including plenty of disclaimers such as "sometimes bots say wrong things very confidently" (iow, a confidence score won't solve this). So yes, it might be useless, but the creators of the bot know and publicly say this. Which makes it even weirder that someone would try and start a Twitter mob over it.
No, it is not. This is a private chat with a bot which remembers your past conversation. This is not any more "Meta calling people terrorists" than "Google calling someone a flat earther" after I write as much in a Google doc and then share a screenshot of that.
But _this_, isn’t a good reason to hate Facebook. It is a weak grasping at straws and reflects a poor understanding of the underlying tech.
Happens to the best of us.
"You're posting too fast. Please slow down. Thanks."
New accounts are rate-limited by default, btw.
They definitely already do that - make it trivial to find misinformation online. It has effectively ruined democracy.
This has a big disclaimer on it about how it is likely to produce misinformation and shouldn’t be used in any serious contexts. Hardly the same.
> Users should be aware that despite our best attempts to reduce such issues, the bot may be inappropriate, rude, or make untrue or contradictory statements. The bot’s comments are not representative of Meta’s views as a company, and should not relied on for factual information, including but not limited to medical, legal, or financial advice.
And to answer her questions about "sources":
> The bot supplements its knowledge by accessing the internet live (via an API with our partners, Mojeek) and by accessing its long-term memory that summarizes historical conversations you’ve had with the bot. You can see and reset these memories when the “look inside” link appears in your chat. You can also click on a message to see more information about how it was constructed, including search queries that were made by the bot.
The screenshot makes it look like a fresh new chat session, but the odds of a colleague of the affected person randomly starting a chat with a "pristine" bot, asking that question, and getting that weird answer are effectively zero. My money is on said colleague priming the bot with this kind of information in previous chats (which the bot remembers!) just to create this screenshot.
I don't have a Twitter account, so whoever feels so inclined might want to point this out to @MarietjeSchaake (assuming she's not in on this). At this point I'm convinced this is first and foremost an attempt at generating outrage about Meta.