News for hackers. Stuff that matters.
Re:OpenAI API pricing update FAQ by simonw on Monday August 22, 2022 @02:06PM (#32555002)
I wrote a few notes in this comment: https://news.ycombinator.com/item?id=32554955

Here's one that I find personally really interesting:

Imagine you have a disability, and the government agencies responsible for helping you have denied your claim. You need to write them a letter. You don't have much (if any) experience writing letters to government agencies, so you're finding that task challenging.

GPT-3 can write that letter for you, and it will de a really good job of it.

Of course, you need access to GPT-3 and you need to learn how to drive it with prompts, so this isn't necessarily an easy thing. But I think it helps lean in the direction of the kind of benefits people can get from this class of technology outside of just playing with the AI.

Re:OpenAI API pricing update FAQ by aabhay on Monday August 22, 2022 @02:08PM (#32555030)
How is this different or more useful than providing a template with madlibs-style fill in the blanks?
Re:OpenAI API pricing update FAQ by simonw on Monday August 22, 2022 @02:11PM (#32555063)
Because providing a template requires someone with knowledge of that particular problem space (in this case "writing letters to government agencies to inquire about disability benefits") to put in the work of designing the template, coming up with likely placeholders and predicting how people might need to use it.

GPT-3 can do a good job of this all today, without any additional training.

An expert could help out by providing a few example prompts, but the result would be a lot more powerful and require a lot less development work to put together than trying to build some kind of placeholder wizard from scratch.

Re:OpenAI API pricing update FAQ by aabhay on Monday August 22, 2022 @02:34PM (#32555364)
A madlibs is more predictable, requires only one example, easy to understand for people with language issues or disabilities, more regulation-safe as it doesn't spit out unpredictable things.

And the madlibs is free to use, for everyone.

All things considered, GPT-3 is a more of a shibboleth of AI revolution than an actual one. Much better to give models like GPT-NeoX to talented development teams who can really optimize and fine tune it, attach great sampling strategies to it, and create great products from there. The API is just too limited for me to want to build a company atop it.

Re:OpenAI API pricing update FAQ by simonw on Monday August 22, 2022 @05:01PM (#32557205)
Right, but someone still has to build it.

If no-one has built the madlib template for "a letter to the council asking about my disability benefits" then madlibs being more predictable isn't going to help you.

Re:OpenAI API pricing update FAQ by dr_dshiv on Monday August 22, 2022 @02:11PM (#32555055)
Because you can tell GPT3 what the concept is — ie, vaguely what you are going for and it will produce. Waaay more flexible than a template.
Re:OpenAI API pricing update FAQ by aabhay on Monday August 22, 2022 @02:31PM (#32555321)
Still requires you to have an understanding of the concept, an understanding of how to prompt GPT-3, and how to verify the accuracy/veracity of the claims the AI model makes.