News for hackers. Stuff that matters.

A comment on Show HN: I built an OSS alternative to Azure OpenAI services. Parent comment

Re:Show HN: I built an OSS alternative to Azure OpenAI services by ij23 on Thursday December 14, 2023 @07:20AM (#38640584)
hi i'm the maintainer of litellm - we persist rate limits, they're written to a DB: https://docs.litellm.ai/docs/proxy/virtual_keys

- LiteLLM Proxy IS Exactly Compatible with the OpenAI SDK

[ Parent | on HN ]

There are no comments on this comment yet.