News for hackers. Stuff that matters.

A comment on Show HN: I built an OSS alternative to Azure OpenAI services. Parent comment

Re:Show HN: I built an OSS alternative to Azure OpenAI services by computerex on Monday December 11, 2023 @04:43PM (#38605933)
OpenAI API doesn't support batching afaik.
[ Parent | on HN ]
Re:Show HN: I built an OSS alternative to Azure OpenAI services by HellsMaddy on Monday December 11, 2023 @04:53PM (#38606040)
They do: https://platform.openai.com/docs/guides/rate-limits/batching...
[ Parent | on HN ]
Re:Show HN: I built an OSS alternative to Azure OpenAI services by treprinum on Monday December 11, 2023 @04:55PM (#38606052)
Embeddings can be batched.
[ Parent | on HN ]