News for hackers. Stuff that matters.
Re:15.ai by Der_Einzige on Sunday June 12, 2022 @06:18PM (#31718808)
In the case of text generation, we call this "Constrained Text Generation" and it is an active field of research. Without going into too many details (I have a paper out for review about this), it's pretty trivial to get "interactive control over how much or how little the AI generates" by a combination of filters on the LMs vocabulary, and effective selection of the various hyperparamaters in the decoder (top_p, top_k, temperature)...

There are no comments on this comment yet.