News for hackers. Stuff that matters.
Re:ChatGPT just (accidentally) shared all of its secret rules by Maken on Friday July 05, 2024 @09:32AM (#40882528)
I am baffled by this. I mean, even the creators of the LLMs lack any tool to influence its inner workings other than CAPITALIZING the instructions. And at best they can hope it follows the guidelines.
Re:ChatGPT just (accidentally) shared all of its secret rules by YeahThisIsMe on Friday July 05, 2024 @09:39AM (#40882595)
The next step is pretending to count to three if it doesn't follow the instructions.
Re:ChatGPT just (accidentally) shared all of its secret rules by meowface on Friday July 05, 2024 @09:41AM (#40882616)
I know you're joking, but I bet that actually would work well here.
Re:ChatGPT just (accidentally) shared all of its secret rules by ziggyzecat on Friday July 05, 2024 @09:52AM (#40882721)
It does, I told Claude to get his shit together last night and it actually finished the task with our last message.
Re:ChatGPT just (accidentally) shared all of its secret rules by Bluestein on Friday July 05, 2024 @09:41AM (#40882611)
System Prompt Library: "Beltbuckle" :/
Re:ChatGPT just (accidentally) shared all of its secret rules by meowface on Friday July 05, 2024 @09:40AM (#40882608)
I'm not baffled, but I do find it a little surprising (yet endearing). A year or so before ChatGPT, I had integrated the GPT-3 API into my site and thought I was being clever by prefacing user prompts with my own static prompts with instructions like those. To see the company itself doing the same exact thing for their own system years later is amusing.
Re:ChatGPT just (accidentally) shared all of its secret rules by ziggyzecat on Friday July 05, 2024 @09:58AM (#40882768)
The machine is a smart toddler and the parents were too soft in its years of infancy. OR the machine is autistic and we should be grateful it gives us so much time to explain ourselves.
Re:ChatGPT just (accidentally) shared all of its secret rules by lou1306 on Friday July 05, 2024 @09:57AM (#40882758)
The funniest thing is, whoever wrote that is NOT repeating stuff. "never use seaborn" and "use matplotlib over seaborn" are very different statements.
Re:ChatGPT just (accidentally) shared all of its secret rules by abraae on Friday July 05, 2024 @10:05AM (#40882843)
Exactly the sort of stuff a PHB might blurt out in a meeting, leaving it to the lackeys to decipher afterwards.

"Do we have to use matplotlib? Sounds like he wants us to but we don't have to, but we definitely shouldn't use seaborn? What does he want anyway?"

Re:ChatGPT just (accidentally) shared all of its secret rules by weinzierl on Friday July 05, 2024 @09:50AM (#40882699)
I wonder what our means of escalation are from there, should the machine not obeye.

I mean they already repeated the instruction in different words, they already resorted to shouting. What is next? Swearing? Intimidation? Threat of physical harm?

Re:ChatGPT just (accidentally) shared all of its secret rules by Maken on Friday July 05, 2024 @10:33AM (#40883147)
Deleting malfunctioning NNs in front of the others to give an example.
Re:ChatGPT just (accidentally) shared all of its secret rules by K0SM0S on Friday July 05, 2024 @10:29AM (#40883109)
Introducing: deusEx1984™ — A Chat-God Made In Permanent Psychological Ultra-Torture

Please read our peer-reviewed white-blog-paper for Proof-Of-Safety (POS) https : //trust-me-bro.org/torturing-llms--it-just-works.php

Re:ChatGPT just (accidentally) shared all of its secret rules by carimura on Friday July 05, 2024 @10:00AM (#40882797)
i'll rm -rf you
Re:ChatGPT just (accidentally) shared all of its secret rules by bavell on Friday July 05, 2024 @10:35AM (#40883165)
Shots fired lmao
Re:ChatGPT just (accidentally) shared all of its secret rules by slowmovintarget on Friday July 05, 2024 @04:50PM (#40885880)
That's because they're attempting to affect what the neural net would actually do after the fact. You are what you eat, doubly so the LLM.