News for hackers. Stuff that matters.
Re:We're expanding our Gemini 2.5 family of models by fastest963 on Tuesday June 17, 2025 @01:35PM (#44301628)
Yes, we implemented a separate service internally that interfaces with an LLM and so the callers can be agnostic as to what provider or model is being used. Haven't needed to load balance between models though.

There are no comments on this comment yet.