News for hackers. Stuff that matters.
Re:GPT Neo: open-source GPT model, with pretrained 1.3B & 2.... by kristoo on Tuesday March 23, 2021 @12:19PM (#26556787)
You might get some really promising results with finetuning.

If anything, you could build writing assistance that almost automates responses.

I've been co-authoring a library that lets you finetune such models in a single line of code.

https://github.com/backprop-ai/backprop

In specific the text generation finetuning example should be what you are looking for: https://github.com/backprop-ai/backprop/blob/main/examples/F...

Hope this helps, happy to chat more about it. Pretty curious about the results.

There are no comments on this comment yet.