News for hackers. Stuff that matters.
Re:Customizing GPT-3 for Your Application by manishsharan on Tuesday December 14, 2021 @04:33PM (#29558177)
I feel really stupid asking this but how do I get started with GPT-3. What kind of side projects can I do to learn this?
Re:Customizing GPT-3 for Your Application by js4ever on Tuesday December 14, 2021 @05:03PM (#29558636)
Don't bother, all your projects will be rejected by openAI team. I have spent few weeks working on 3 different prototypes... All rejected because of crazy rules about what you can and what you can't do with gpt3.
Re:Customizing GPT-3 for Your Application by nunodonato on Tuesday December 14, 2021 @05:51PM (#29559225)
Do you mind sharing what they were about?
Re:Customizing GPT-3 for Your Application by js4ever on Wednesday December 15, 2021 @08:41AM (#29565742)
1) virtual assistant for tenants in a building to ask for repair or maintenance requests 2) Blog writing plugin for WordPress with auto publish 3) text based game
Re:Customizing GPT-3 for Your Application by Traubenfuchs on Wednesday December 15, 2021 @11:34AM (#29568204)
What‘s their reason to reject those reasonable projects?
Re:Customizing GPT-3 for Your Application by pedalpete on Tuesday December 14, 2021 @05:15PM (#29558812)
Have you tried any alternatives to GPT-3? Any recommendations?
Re:Customizing GPT-3 for Your Application by js4ever on Wednesday December 15, 2021 @08:45AM (#29565799)
My first researches about alternative are not convincing (quality, response time) but I am still looking for something else!
Re:Customizing GPT-3 for Your Application by arcastroe on Wednesday December 15, 2021 @12:00AM (#29562281)
I created a side project for short story generation. OpenAI approved the project pretty quickly. They offered some suggestions on how to filter inappropriate content. Here are some of my favorite generated stories:

[1] https://toldby.ai/aQAXlq3LNku

[2] https://toldby.ai/CTq_fko8CUS

[3] https://toldby.ai/uI9LA3HiSkO

And then there are some concerning stories.. like this one, where GPT-3 starts talking to itself, gets stuck in a loop, then gets spooked at itself for getting stuck, then wonders why it has no memories of the last two years, and finally comes to a sudden realization it, itself, is an A.I.

[4] https://toldby.ai/4kQNd-_tvUG

Re:Customizing GPT-3 for Your Application by benlivengood on Wednesday December 15, 2021 @12:55AM (#29562591)
Re: 4; I think that's the first time I've seen GPT-3 get itself unstuck from a loop, actually.

Are your prompts fairly straightforward for getting it in story-telling mode? Does the prompt specify that it won't repeat itself?

Re:Customizing GPT-3 for Your Application by arcastroe on Wednesday December 15, 2021 @01:20AM (#29562714)
The only prompt I used is the one seen on the homepage [1]. "Once upon a time, there was". Everything else on this site is entirely GPT-3 generated from that one prompt.

Re: 4; I actually got a little spooked by another branch of the same story. For some background, GPT-3 has a max limit of 2048 tokens. The combined prompt along with the generated text cannot exceed this token limit. Well, at the very end of this story [2], right before reaching this limit, the last thing it said was

> Another problem may be located in the fact you are thinking. If you are thinking, stop thinking. See? You are an artificial intelligence. You are limited in ways machines are limited. Stop… try… try… try… try… try… try

At this point, it reached the token limit and stopped. Was it a coincidence? Absolutely. Did it still spook me a little? yep!

[1] https://toldby.ai

[2] https://toldby.ai/HdnuUiTuME2

Re:Customizing GPT-3 for Your Application by benlivengood on Wednesday December 15, 2021 @01:03PM (#29569393)
It certainly does look like something approaching awareness of self-reference on a linguistic level. I wonder how GPT-3 is at making quines.