News for hackers. Stuff that matters.
Re:Scientists claim >99 percent identification rate of ChatG... by irthomasthomas on Thursday June 08, 2023 @10:05AM (#36242080)
I see you are further along the path to prompting wisdom than op.

Positive directions are far superior to negative ones. LLMs don't understand the concept of negation. They work, in a way, by assigning semantic tokens that describe the relationship to other tokens. How could you encode the idea of a negated token?

I have wondered if you could use a similar mechanism to the repetition penalty to penalise chosen tokens that you want to downrank.

Re:Scientists claim >99 percent identification rate of ChatG... by aubanel on Thursday June 08, 2023 @10:29AM (#36242454)
I this idea of LLMs not understanding the concept of negation is false.

Both if you ask ChatGPT (GPT4) to explain the concept of negation or ask it to do a task that leverages negation, you get sound results.

Example of a conversation leveraging negation:

User Hello GPT. Could you write me a sentence longer than 6 words ?

ChatGPT: Of course, I'd be happy to help! Here's a sentence for you: "The sun set behind the mountains, casting a stunning array of colors across the evening sky."

User: Now, could you write me a sentence not longer than 6 words ?

ChatGPT: Absolutely, here it is: "Cats quietly nap in the sun."