News for hackers. Stuff that matters.

curiousDev1

Looks cool. So is your (semi-longer term) focus now on supporting observability for self-hosted models? As, OpenAI has introduced features for child key creation / monitoring / access control etc. Also, how do you compare with Helicone?
Re: on Thursday December 07, 2023 @06:55PM (#38563521)
Hey all, we all building a product to make it hassle-free to monitor the LLM API usage of each user, so that businesses can adapt their pricing models and enforce user limits. Any feedback is greatly appreciated!