News for hackers. Stuff that matters.

A comment on Show HN: PromptTools – open-source tools for evaluating LLMs and vector DBs.

Re:Show HN: PromptTools – open-source tools for evaluating L... by mmaia on Tuesday August 01, 2023 @06:54PM (#36964389)
I like that it's not limited to single prompts and allows to have chat messages. It would be great if `OpenAIChatExperiment` could also handle OpenAI's function calling.
[ Parent | on HN ]
Re:Show HN: PromptTools – open-source tools for evaluating L... by krawfy on Tuesday August 01, 2023 @07:03PM (#36964480)
Good catch! We're looking to add function calling support very soon, and have an open issue for it on our GitHub. If you want to raise a PR and add it, we'll help you land it and get it merged
[ Parent | on HN ]