Why is promptfoo so popular?

Re:Why is promptfoo so popular? by dabs on Friday July 26, 2024 @11:55PM (#41084333)

I have seen frameworks in other spaces attempt the configuration driven approach and have seen it always fall out of favor vs. programmatic approaches. I am reading the docs right now and I feel like it's so much work to try to learn the syntax of their YAML specification vs. using something like LangFuse. The fact that you can write code as an array element in a YAML low key makes me angry.

Yet this is used in Shopify, Microsoft, etc. supposedly. Are there people here who have chosen promptfoo over other alternatives? Why?

[ Parent | on HN ]

Re:Why is promptfoo so popular? by dabs on Saturday July 27, 2024 @12:08AM (#41084393)

Seriously, this is a statement you can make in promptfoo configuration:

```

    assert:

      - type: equals

        value: 'Hello, World!'

```

We are redefining the equality operator in YAML. Someone please explain.

[ Parent | on HN ]