News for hackers. Stuff that matters.
Re:Prompt Engineering vs. Blind Prompting by skybrian on Saturday April 22, 2023 @02:48PM (#35669719)
Learning to say what you want is a skill. Much like you can get better at searching, you can get better at saying what you want.

The framework described in the blog post seems like a more formal way to do it, but there are other ways to iterate in conversation. After seeing the first result, you can explain better what you want. If you're not expecting to repeat the query then maybe that's good enough?

I expect there will be better UI's that encourage iteration. Maybe you see a list of suggested prompts that are similar and decide which one you really want?

Re:Prompt Engineering vs. Blind Prompting by fwlr on Saturday April 22, 2023 @08:17PM (#35672114)
> Learning to say what you want is a skill

True, but “learning to figure out what someone wanted to say but wasn’t able to express themselves” is also a skill, I expect LLMs will be able to learn that pretty well.

Imagine you prompt ChatGPT4.5 and it doesn’t give you what you want. You click the thumbs down. ChatGPT says “Hold on, let me try again”. (Behind the scenes, OpenAI runs your prompt through their “prompt improver”, replaces your prompt with that prompt, and just shows you the output, no point showing the optimized prompt since it might be gibberish to a human). The new response actually is what you want, so you click thumbs up on the new output. That “thumbs down, thumbs up” pattern generates high quality labeled data for training the prompt improver, with very little cost.

Re:Prompt Engineering vs. Blind Prompting by andygeorge on Saturday April 22, 2023 @08:37PM (#35672235)
> very little cost

first time?

Re:Prompt Engineering vs. Blind Prompting by yorwba on Sunday April 23, 2023 @05:19AM (#35674677)
Yes, "thumbs up, thumbs down" voting is a pretty good way to collect directionally unambiguous feedback that can easily be aggregated across many users to serve as training data.

But it's terrible interaction design for communicating what you want. Imagine trying to fulfill the 1001st most common user need and pressing "thumbs down" 1000 times until you finally get there.

In such cases, being able to construct a more specific prompt would save you a lot of time.

Re:Prompt Engineering vs. Blind Prompting by cyanydeez on Saturday April 22, 2023 @08:30PM (#35672203)
Remember when Google search actually found the words you were searching for instead of creating some quasi common search keywords in a. Shallow pool of most ranked websites?

Right now, most of these AI systems are no better than current Google search. Weird and ironic.

Re:Prompt Engineering vs. Blind Prompting by resters on Sunday April 23, 2023 @01:37AM (#35673587)
Example please