Re:Show HN: OpenLIT – Open-Source LLM Observability with Ope...
by patcher99 on Sunday April 28, 2024 @11:23PM
(#40194112)
Yeah, 100%, I couldn't agree more on this!
Though if you'd like to see something more, Lemme know!
Thanks!
They have an observability platform for LLMs and other generative AI services. Just like you can use observability tools on services like databases or APIs, they’ve made an observability tool for the aforementioned AI services and the applications built with them. They use OpenTelemetry, a pretty standard observability protocol, to interoperate with other tools that ingest observability-oriented data.