News for hackers. Stuff that matters.
Re:GPT-3 pricing for API usage announced to beta users to go... by d--b on Thursday September 03, 2020 @03:01AM (#24361475)
is there any non-malignent use case for gpt-3?
Re:GPT-3 pricing for API usage announced to beta users to go... by ma2rten on Thursday September 03, 2020 @03:02AM (#24361480)
Re:GPT-3 pricing for API usage announced to beta users to go... by renewiltord on Thursday September 03, 2020 @03:26AM (#24361602)
I used talktotransformer.com to write stories for myself. Some of them were great inspiration material. The bot's pretty good with ideas.
Re:GPT-3 pricing for API usage announced to beta users to go... by neoncontrails on Thursday September 03, 2020 @08:47PM (#24370638)
I agree, GPT-2 makes an excellent writing companion. I actually developed my own version of talktotransformer.com to introduce some features that were missing from the public demo, including:

* support for custom/fine-tuned/international GPT-2 models. Use any text generation model you want!

* support for multiple outputs. Generate as many suggestions as you want!

* support for customizing the prediction length. Can't think of that next word? You can effectively 'poll' the model by reducing the window size and increasing the number of suggestions: the most 'sensible' (or safe) choice usually appears most often. Or, go wild and let GPT-2 write the entirety of your boring, corporate email for you.

* a more interactive user experience. No need to submit a blocking POST request and wait for the server to respond; just type '...' to (async) fetch a new batch of suggestions. The interface will update as soon as those predictions become available.

Here's a video of the application brainstorming some new features for itself: https://streamable.com/jij614

I didn't realize talktotransformer.com had been taken down. I hadn't been in a hurry to publish the code, mainly because it's going to be a little tricky to distribute (you might have noticed in the video that the GPT-2 model is loaded into a Google Colab notebook that accepts GET requests, then queried remotely), but if people are interested I can absolutely give it a shot.

Re:GPT-3 pricing for API usage announced to beta users to go... by renewiltord on Friday September 04, 2020 @12:31AM (#24371716)
That is very cool, my dude. Someone else also built an AI writing assistant like this that I tried. It was really quite good.
Re:GPT-3 pricing for API usage announced to beta users to go... by inetsee on Thursday September 03, 2020 @09:39AM (#24363912)
"This demo (talktotransformer) is turned off for the moment." It appears to have been replaced by https://inferkit.com/ . I don't know how the usage limits for inferkit compare to talktotransformer. The pricing page can be found here https://inferkit.com/pricing .
Re:GPT-3 pricing for API usage announced to beta users to go... by minimaxir on Thursday September 03, 2020 @12:25PM (#24365669)
TalkToTransformers was free when the hardware is really, really expensive to scale.
Re:GPT-3 pricing for API usage announced to beta users to go... by terrycody on Thursday September 03, 2020 @09:37PM (#24370919)
thanks for posting:

They are using GPT-2 if I am right, will they use GPT-3 in the coming weeks? Btw, I would love to know any other similar services that can let you input a sentence or words to generate any length readable contents.

Thank you!

Re:GPT-3 pricing for API usage announced to beta users to go... by scoot_718 on Thursday September 03, 2020 @06:36AM (#24362635)
All the good ones would require the actual model and not this shitty API
Re:GPT-3 pricing for API usage announced to beta users to go... by polytely on Thursday September 03, 2020 @09:16AM (#24363717)
My guess it's will be very useful for helping weak writers write better texts. Like the user tells the computer what they want to convey through a letter/email/text, the computer gives them like 3 example sentences that could work and the user picks what is most applicable. There is probably going to be a booming business of AI assisted writing.
Re:GPT-3 pricing for API usage announced to beta users to go... by drabiega on Thursday September 03, 2020 @08:04AM (#24363145)
AI Dungeon is a pretty great use case. I'm not sure if it'll survive this pricing, though.