News for hackers. Stuff that matters.

Ask HN: Anyone know any OpenAI API hosted alternatives?

I am explicitly looking for API alternatives (not guis) to call GPT-3 models (don't necessarily need ChatGPT memory behavior)

Unfortunately, OpenAI's api offering has slowed down a lot and is extremely inconsistent in response times. (I'm assuming they are struggling to scale and/or sometimes you get session-ed up with a congested data centre)

This is a pretty common theme for the past few months in their community forums -> https://community.openai.com/t/api-gpt-3-5-turbo-sucks-slow/147230/8

If anyone knows a less congested alternative I would greatly appreciate it (don't mind if it's of lesser quality responses)

( 8 comments | 2 points | on HN )
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by aiunboxed on Wednesday May 24, 2023 @10:54PM (#36066588)
Yes that is the truth the open AI API is indeed very slow and inconsistent. Have heard people say that Azure open AI integration is a little better ?

Claude is also under limited preview right now.

Also waiting for some reliable API which can be used in customer facing applications

Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by krishadi on Thursday May 25, 2023 @03:37AM (#36068015)
Claude isn't super fast either. It's about a third or so.
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by billconan on Wednesday May 24, 2023 @10:54PM (#36066586)
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by aiunboxed on Wednesday May 24, 2023 @10:54PM (#36066591)
claude is under limited preview right ?
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by Meic on Wednesday May 24, 2023 @11:44PM (#36066848)
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by tikkun on Thursday May 25, 2023 @07:45AM (#36069497)
1. Claude by Anthropic (but, expect to wait weeks/months before getting off the waitlist, which makes their offering pretty uncompelling)

2. Cohere

3. https://inferkit.com or https://textsynth.com/pricing.html

Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by kgbcia on Thursday May 25, 2023 @08:24AM (#36069870)
What do people think about a self hosted gpt-j 6b model?
Re:Ask HN: Anyone know any OpenAI API hosted alternatives? by juliensalinas on Thursday May 25, 2023 @10:05AM (#36070873)
You might want to try NLP Cloud: https://nlpcloud.com