Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry

Re:Show HN: OpenLIT – Open-Source LLM Observability with Ope... by asabla on Sunday April 28, 2024 @04:07PM (#40191380)

So, do I understand this right. But is this supposed to be a centralized (in a way) application for collecting all OpenTelemtry data related to LLM's? And it's supposed to support various of related services and/or services today?

I see how this can be really useful. But at the same time, how do you guys see your self differentiate your self from cloud hosted equivalents? (e.g dashboard-like services in Azure and similar).

Anyhow, interesting project. I'll keep an eye on it for future use

[ Parent | on HN ]

Re:Show HN: OpenLIT – Open-Source LLM Observability with Ope... by patcher99 on Sunday April 28, 2024 @11:21PM (#40194098)

Yup, You are on point! We do see the UI/dashnoarding layer to find other usage a bit more as we add more tools(Compare/Evaluate) to help the overall LLM Developer Experience.

Also, I totally get the existing tools like Grafana are great, which is why we built our SDK in a very vendor neutral way using OTEL, So that yiu can send these traces and meyrics to our choice of OTLP backend.

Thanks!

[ Parent | on HN ]