News for hackers. Stuff that matters.
Re:Generating Fake Conversations by Fine-Tuning OpenAI's GPT... by gwern on Thursday March 14, 2019 @10:16AM (#19389388)
As it happens, nshepperd ran his finetuning GPT-2-small on our IRC channel. I'd tried it before with char-RNN back in 2015 or so, and I have to say, GPT-2-small trained way faster and better than my IRC char-RNN did.

The samples also looked a lot better than OP's. I assume that's because he ran it for more like a day on a few hundred MB of chat logs.

Re:Generating Fake Conversations by Fine-Tuning OpenAI's GPT... by gwern on Friday March 15, 2019 @09:20AM (#19399395)