Re:Show HN: I made a free-to-use GPT-2 API
by edunteman on Tuesday September 22, 2020 @09:37PM
(#24562037)
Working on a feature that allows you to define your common phrases, and it'd bias the output toward that. See my response to knicholas in this thread. It's not a perfect fix but would work.
Other APIs I launch in the future should help. BERT comes to mind. You could generate multiple options using GPT2, then have BERT assess if they're in your style.
Re:Show HN: I made a free-to-use GPT-2 API
by knicholes on Tuesday September 22, 2020 @09:13PM
(#24561920)
You fine-tune the end layers of the network with your own writing. This, however, requires the model.
Re:Show HN: I made a free-to-use GPT-2 API
by edunteman on Tuesday September 22, 2020 @09:32PM
(#24562016)
Working on a fine-tuning add-on currently :) The one I'm working with is called PPLM by Uber eng, and it takes a "bag of words" to keep generated text on topic. It's not exactly what you're asking for (style transfer), but you'd be able to load it with your common email phrases, and the postprocessing will bias similar phrases, keeping it somewhat stylistically consistent.
It says on the website "Predict the next word(s) from a given sequence of words." Speaking as someone who has very little programming knowledge, would it be possible to use this to create a gmail like auto-complete with this? If so, how can I make it so that the words generated resemble my own writing style (like gmail auto-complete does?).