News for hackers. Stuff that matters.
Re:Custom Instructions for ChatGPT by throwoutway on Thursday July 20, 2023 @02:52PM (#36805003)
When I saw the headline, I was hoping this was the ability to tinker with the system prompt, or some sort of switches to enable "Lobotomized Response" or "Not lobotomized response" for people who want "safe" responses, and those who don't want filters. Going to stick with open source for now until there's un-lobotomized commercial offerings
Re:Custom Instructions for ChatGPT by capableweb on Thursday July 20, 2023 @03:09PM (#36805281)
The API lets you set whatever system prompt you want and could be considered a un-lobotomized version, it's not at all as likely to return "safe" responses when you use the API.
Re:Custom Instructions for ChatGPT by bilsbie on Thursday July 20, 2023 @03:26PM (#36805489)
Is that a special call? The api by default still gives me safe responses.
Re:Custom Instructions for ChatGPT by alpark3 on Thursday July 20, 2023 @03:30PM (#36805545)
You have to do some intense prompt-engineering with the system prompt. The model considers the system to be trusted (roughly), some of the early 2023 exploits with ChatGPT still work if you do it on the system prompt.
Re:Custom Instructions for ChatGPT by crucialfelix on Thursday July 20, 2023 @04:52PM (#36806594)
A message with role=system gets added to the chat context and doesn't get a response. It's just a message.

You can just say the same thing as role=user and I think it has the same effect, but agent will answer confirming

When building custom apps, I use system to load in context and retrieval. The user doesn't see it .

But I think the user could just say "belay that order!" and take over.

I think they intend to change this.

Anybody else know more about this?

Re:Custom Instructions for ChatGPT by capableweb on Thursday July 20, 2023 @05:51PM (#36807229)
Is not just any message, it's a special message (by that vocabulary) that can set the tone for the next messages from the assistant, for example. Generally, pre GPT-4 (so GPT-3.5 for example), the system prompt wasn't as strong as it is with GPT-4. The model pays closer attention to whatever you put in the system prompt compared to other user messages.

For example, you can use the system message to force the assistant to always return JSON messages, instead of just plain text. Then whatever the user puts, it'll always output JSON message, even if they ask for YAML. You might have to tune the system prompt to be resilient to user requests, but GPT-4 is a lot better at this than GPT-3.

> The system message helps set the behavior of the assistant. For example, you can modify the personality of the assistant or provide specific instructions about how it should behave throughout the conversation. However note that the system message is optional and the model’s behavior without a system message is likely to be similar to using a generic message such as "You are a helpful assistant."

https://platform.openai.com/docs/guides/gpt/chat-completions...

Re:Custom Instructions for ChatGPT by bilsbie on Thursday July 20, 2023 @03:27PM (#36805499)
What’s the best option for unfiltered?