News for hackers. Stuff that matters.

Ask HN: How do you evaluate prompts?

We've been developing prompts for writing agents with OpenAI. After working on it for the last months, we have a huge amount of prompts lying everywhere. We don't have a good workflow around keeping tracking of prompts, scoring them, revisiting them later on, tacking their output and degradation to give the right output over time.

How do people here do this? What is your workflow around this?

( 2 comments | on HN )
Re:Ask HN: How do you evaluate prompts? by gbertb on Sunday May 07, 2023 @12:42PM (#35853202)
Re:Ask HN: How do you evaluate prompts? by krishadi on Sunday May 07, 2023 @01:06PM (#35853426)
Have you been using promptlayer? How does it fare for you?