OpenAI API pricing update FAQ

Re:OpenAI API pricing update FAQ by AJRF on Monday August 22, 2022 @01:34PM (#32554629)

> We have been looking forward to reducing pricing for a long time. Our teams have made incredible progress in making our models more efficient to run, which has reduced the cost it takes to serve them, and we are now passing these savings along to our customers.

Nothing to do with Stable Diffusion then, no?

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by tvhahn on Monday August 22, 2022 @03:09PM (#32555797)

Why bother use a GPT-3 model when you can use the free BLOOM model? Large "foundation" models will become a commodity -- a race to the bottom.

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by grej on Monday August 22, 2022 @04:30PM (#32556803)

I have used BLOOM a little, and I struggle to get it to produce the same kind of output as GPT-3. Anyone have tips there? It often seems to not keep the right context of the previously generated text.

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by aljungberg on Monday August 22, 2022 @05:09PM (#32557306)

GPT-3 has been fine-tuned after release to better interpret prompts (see InstructGPT). Perhaps Bloom is more like the original GPT-3; a little more raw and requiring better prompt engineering?

In my small amount of testing of Bloom so far it seems capable of advanced behaviour but it can indeed be trickier to coax that out. Playing with temperature and sampling matters for sure.

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by juliensalinas on Tuesday August 23, 2022 @01:50AM (#32560892)

I've been testing BLOOM for a while and it seems it is working very well with good few-shot learning. See this post about prompt examples: https://nlpcloud.com/effectively-using-gpt-j-gpt-neo-gpt-3-a... All of these examples work great with BLOOM.

But for the moment you can't just use pure natural language instructions with BLOOM indeed. Maybe it will come!

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by choppaface on Monday August 22, 2022 @03:43PM (#32556233)

It’s not just Stable Diffusion the model, but the research is become really actually open unlike “open ai”

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by JimmyAustin on Monday August 22, 2022 @01:51PM (#32554835)

Given that Dall-E 2's pricing hasn't changed, probably not.

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by aaroninsf on Monday August 22, 2022 @03:11PM (#32555817)

Now that StableDiffusion is released, I expect that to change, unless there is a (certainly ultimately doomed) attempt to Hold the Line.

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by lee101 on Monday August 22, 2022 @06:01PM (#32557857)

Yes this move is I think forced hand by competitors like https://text-generator.io etc which is already 10x cheaper.

If the open source community then other company's didn't follow along with them then we would still be being price gauged in a monopoly situation, hopefully same thing happens to dalle soon

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by cma on Monday August 22, 2022 @02:43PM (#32555466)

Could be the GPU price crash as well (even if they use Google's TPUs, TPU demand would presumably go down in a GPU price crash).

[ Parent | on HN ]

Re:OpenAI API pricing update FAQ by tomComb on Monday August 22, 2022 @02:51PM (#32555570)

Microsoft bought control of OpenAI so I believe this would all be running on Azure (so would not be using Google TPU's).

[ Parent | on HN ]