I agree, GPT-2 makes an excellent writing companion. I actually developed my own version of talktotransformer.com to introduce some features that were missing from the public demo, including:

* support for custom/fine-tuned/international GPT-2 models. Use any text generation model you want!

* support for multiple outputs. Generate as many suggestions as you want!

* support for customizing the prediction length. Can't think of that next word? You can effectively 'poll' the model by reducing the window size and increasing the number of suggestions: the most 'sensible' (or safe) choice usually appears most often. Or, go wild and let GPT-2 write the entirety of your boring, corporate email for you.

* a more interactive user experience. No need to submit a blocking POST request and wait for the server to respond; just type '...' to (async) fetch a new batch of suggestions. The interface will update as soon as those predictions become available.

Here's a video of the application brainstorming some new features for itself: https://streamable.com/jij614

I didn't realize talktotransformer.com had been taken down. I hadn't been in a hurry to publish the code, mainly because it's going to be a little tricky to distribute (you might have noticed in the video that the GPT-2 model is loaded into a Google Colab notebook that accepts GET requests, then queried remotely), but if people are interested I can absolutely give it a shot.

That is very cool, my dude. Someone else also built an AI writing assistant like this that I tried. It was really quite good.

"This demo (talktotransformer) is turned off for the moment." It appears to have been replaced by https://inferkit.com/ . I don't know how the usage limits for inferkit compare to talktotransformer. The pricing page can be found here https://inferkit.com/pricing .

TalkToTransformers was free when the hardware is really, really expensive to scale.

thanks for posting:

They are using GPT-2 if I am right, will they use GPT-3 in the coming weeks? Btw, I would love to know any other similar services that can let you input a sentence or words to generate any length readable contents.

Thank you!