News for hackers. Stuff that matters.
Re:Show HN: PromptTools – open-source tools for evaluating L... by krawfy on Tuesday August 01, 2023 @01:05PM (#36958870)
For now, we just aggregate those across the models / prompts / templates you're evaluating so that you can get an aggregate score. You can export to CSV, JSON, MongoDB, or Markdown files, and we're working on more persistence features so that you can get a history of which models / prompts / templates you gave the best scores to, and keep track of your manual evaluations over time.

There are no comments on this comment yet.