News for hackers. Stuff that matters.
Re:Show HN: Litellm – simple library to standardize OpenAI, ... by detente18 on Saturday August 12, 2023 @05:48PM (#37104544)
You're probably calling openai from a backend server. If you're making the call because a user asked a question -> your endpoint received it -> did some processing -> called openai -> returned the response,

why would you cache the openai call instead of the endpoint that's receiving the user call?

There are no comments on this comment yet.