Re:GPT-3 Creative Fiction
by james-revisoai on Thursday April 20, 2023 @09:07AM
(#35639347)
I agree.
It's like instruct = Gain cosistentcy, lose creativity. Base = No consistency (really), but creative.
Could a model be trained or positioned to be in the middle of these two?
I suspect you could train a model to just shut up and follow instructions. I.e. instead of "Do X -> Sure! As a large language model, I'd love to help you with X!", just "Do X -> X".
This would avoid giving the model a dull default voice. But it wouldn't be sufficiently hedged and "safe".
It's frustrating to see through those glimpses that this capability exists, but has been trampled over and made mostly inaccessible in pursuit of making sure the tool doesn't ever offend by producing something that's not baby food. And all the open replication efforts are aping this approach. Sigh.