Re:Scientists claim >99 percent identification rate of ChatG...
by aubanel on Thursday June 08, 2023 @10:29AM
(#36242454)
I this idea of LLMs not understanding the concept of negation is false.
Both if you ask ChatGPT (GPT4) to explain the concept of negation or ask it to do a task that leverages negation, you get sound results.
Example of a conversation leveraging negation:
User Hello GPT. Could you write me a sentence longer than 6 words ?
ChatGPT: Of course, I'd be happy to help! Here's a sentence for you: "The sun set behind the mountains, casting a stunning array of colors across the evening sky."
User: Now, could you write me a sentence not longer than 6 words ?
ChatGPT: Absolutely, here it is: "Cats quietly nap in the sun."
Positive directions are far superior to negative ones. LLMs don't understand the concept of negation. They work, in a way, by assigning semantic tokens that describe the relationship to other tokens. How could you encode the idea of a negated token?
I have wondered if you could use a similar mechanism to the repetition penalty to penalise chosen tokens that you want to downrank.