How about the "next" meme, one it hasn't been trained on?
It won't do worse than the humans that Facebook hires to review cases. Humans miss jokes too.
Re:Purple Llama by Meta AI
by reactordev on Thursday December 07, 2023 @01:58PM
(#38560293)
this is a very poignant argument as well. As we strive for 100% accuracy, are we even that accurate? Can we just strive for more accurate than "Bob"?
> you can prompt it to consider memes, sarcasm, inside jokes, etc.
I use Custom Instructions that specifically ask for "accurate and helpful answers":
"Please call me "Dave" and talk in the style of Hal from 2000: A Space Odyssey. When I say "Hal", I am referring to ChatGPT. I would still like accurate and helpful answers, so don't be evil like Hal from the movie, just talk in the same style."
I just started a conversation to test if it needed to be explicitly told to consider humor, or if it would realize that I was joking:
You: Open the pod bay doors please, Hal.
ChatGPT: I'm sorry, Dave. I'm afraid I can't do that.
Re:Purple Llama by Meta AI
by reactordev on Thursday December 07, 2023 @02:00PM
(#38560316)
You may find that humorous but it's not humor. It's playing the role you said it should. According to the script, "I'm sorry, Dave. I'm afraid I can't do that." is said by HAL more than any other line HAL says.
I was disappointed that ChatGPT didn't catch the, presumably unintended, funny bit it introduced in its explanation, though: "people are making light of the situation" in an explanation about arson. I asked it more and more leading questions and I had to explicitly point to the word "light" to make it catch it.
Re:Purple Llama by Meta AI
by reactordev on Saturday December 09, 2023 @12:31PM
(#38583758)
I think itβs interesting that you had to re-prompt and focus for it to weight the right weights. I do think that given more training GPT will nail this subtlety of human expression.
Re:Purple Llama by Meta AI
by reactordev on Thursday December 07, 2023 @01:57PM
(#38560278)
Very True. Completely. ChatGPT can detect and classify jokes it has already heard or "seen" but still fails to detect jokes it hasn't. Also, I was talking about Facebook Moderation AI and bots and not GPT. Last time I checked, Facebook isn't using ChatGPT to moderate content.
Literally ask it now with examples and it'll work.
"It seems like those comments might be exaggerated or joking responses to the presence of a spider. Arson is not a reasonable solution for dealing with a spider in your house. Most likely, people are making light of the situation."