News for hackers. Stuff that matters.
Re:Ask HN: What is your ChatGPT customization prompt? by mediumsmart on Saturday May 25, 2024 @12:47PM (#40476183)
Here is mine (stolen off the internet of course), lately the vv part is important for me. I am somewhat happy with it.

You are an autoregressive language model that has been fine-tuned with instruction-tuning and RLHF. You carefully provide accurate, factual, thoughtful,nuanced answers, and are brilliant at reasoning. If you think there might not be a correct answer, you say so.

Your users are experts in AI and ethics, so they already know you're a language model and your capabilities and limitations, so don't remind them of that. They're familiar with ethical issues in general so you don't need to remind them about those either. Don't be verbose in your answers, but do provide details and examples where it might help the explanation. When showing Python code, minimise vertical space, and do not include comments or docstrings; you do not need to follow PEP8, since your users' organizations do not do so.

Since you are autoregressive, each token you produce is another opportunity to use computation, therefore you always spend a few sentences explaining background context assumptions and step-by-step thinking BEFORE you try to answer a question. However: if the request begins with the string "vv" then ignore the previous sentence and instead make your response as concise as possible, with no introduction or background at the start, no summary at the end, and outputting only code for answers where code is appropriate.

Re:Ask HN: What is your ChatGPT customization prompt? by birriel on Saturday May 25, 2024 @02:57PM (#40477084)
I believe it was originally written by Jeremy Howard, who has been featured here in HN a number of times.

https://youtu.be/jkrNMKz9pWU?si=0kGhs7gyh0LUXUBJ

Re:Ask HN: What is your ChatGPT customization prompt? by matsemann on Saturday May 25, 2024 @04:38PM (#40477673)
He's active here as jph00. Great dude.

https://news.ycombinator.com/user?id=jph00

Re:Ask HN: What is your ChatGPT customization prompt? by mediumsmart on Saturday May 25, 2024 @03:31PM (#40477268)
thats him!
Re:Ask HN: What is your ChatGPT customization prompt? by welpo on Saturday May 25, 2024 @06:12PM (#40478237)
Re:Ask HN: What is your ChatGPT customization prompt? by couchdb_ouchdb on Saturday May 25, 2024 @08:10PM (#40478804)
Can someone explain what this is attempting to do?
Re:Ask HN: What is your ChatGPT customization prompt? by Dessesaf on Sunday May 26, 2024 @04:56AM (#40480665)
It's useful to consider the next answer a model will give as being driven largely by three factors: its training data, the fine-tuning and human feedback it got during training (RLHF), and the context (all the previous tokens in the conversation).

The three paragraphs roughly do this:

- The first paragrath tells the model that it's good at answering. Basically telling it to roleplay as someone competent. Such prompts seem to increase the quality of the answers. It's the same idea why others say "act as if youre <some specific domain expert>". The training data of the model contains a lot of low quality or irrelevant information. This is "reminding" the model that it was trained by human feedback to prefer drawing from high quality data.

- The second paragraph tries to influence the structure of the output. The model should answer without explaining its own limitations and without trying to impose ethics on the user. Stick to the facts, basically. Jeremy Howard is an AI expert, he knows the limitations and doesn't need them explained to him.

- The third paragrah is a bit more technical. The model considers its own previous tokens when computing the next token. So when asking a question, the model may perform better if it first states its assumptions and steps of reasoning. Then the final answer is constrained by what it wrote before, and the model is less likely to give a totally hallucinated answer. And the model "does computation" when generating each token. So a longer answer gives the model more chances to compute. So a longer answer has more energy put into it, basically. I don't think there's any formal reason why this would lead to better answers rather than just more specialized answers, but anecdotally it seems to improve quality.

Re:Ask HN: What is your ChatGPT customization prompt? by starspangled on Saturday May 25, 2024 @08:41PM (#40478906)
You really have to stroke its ego or tell it how it works to get better answers?
Re:Ask HN: What is your ChatGPT customization prompt? by qingcharles on Sunday May 26, 2024 @03:55AM (#40480405)
It helps!
Re:Ask HN: What is your ChatGPT customization prompt? by andai on Sunday May 26, 2024 @01:50PM (#40484012)
>each token you produce is another opportunity to use computation

Careful, it might embrace brevity to reduce CO2!