News for hackers. Stuff that matters.
Re:Show HN: You don't need to adopt new tools for LLM observ... by tomerf2 on Wednesday February 14, 2024 @11:48AM (#39372002)
Thanks!

1. Huh, good question. Hopefully there will be convergence. We started discussing with other companies in this domain to support or even switch to OpenTelemetry.

2. Nothing specific, except for - as you mentioned - being able to see trace of a RAG pipeline automatically.

Re:Show HN: You don't need to adopt new tools for LLM observ... by tomgs on Wednesday February 14, 2024 @11:54AM (#39372073)
A quick one :)

While we're on the topic - how does traceloop factor into all of this? What's the connection between the two? I assume the former is the LLM observability platform (Datadog for LLM?) and the latter is your own auto-instrumentation thingie to supplement it?

Re:Show HN: You don't need to adopt new tools for LLM observ... by nirga on Wednesday February 14, 2024 @11:58AM (#39372130)
Yes, Traceloop is kind of a Sentry for LLMs
Re:Show HN: You don't need to adopt new tools for LLM observ... by ssijak on Wednesday February 14, 2024 @02:31PM (#39374071)
Its priced way high, 500$ for 50k LLM calls? 50k is not much at all.
Re:Show HN: You don't need to adopt new tools for LLM observ... by nirga on Wednesday February 14, 2024 @03:34PM (#39374937)
The open source is free for all ofc. Our platform provides capabilities for monitoring and detecting hallucinations hence cost more.