Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps

Re:Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows ... by unnikrishnan_r on Tuesday December 17, 2024 @02:08PM (#42444237)

Thanks, this post was insightful. I laughed at the reason why you rejected Arize Phoenix, I had similar thoughts while going through their site!=)

> "Another notable feature of Langfuse is the use of a model as a judge ... this is not enabled in the free version/self-hosted version"

I think you can add LLM-as-judge to the self-hosted version of Langfuse by defining your own evaluation pipeline: https://langfuse.com/docs/scores/external-evaluation-pipelin...

[ Parent | on HN ]

Re:Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows ... by suninsight on Wednesday December 18, 2024 @01:22AM (#42448499)

Thanks for the pointer !

We are actually toying with building out a prompt evaluation platform and were considering extending langfuse. Maybe just use this instead.

[ Parent | on HN ]