News for hackers. Stuff that matters.
Re:A guidance language for controlling LLMs by marcotcr on Tuesday May 16, 2023 @01:55PM (#35965369)
We're biased, but we think guidance is still very useful even with OpenAI models (e.g. in https://github.com/microsoft/guidance/blob/main/notebooks/ch... we use GPT-4 to do a bunch of stuff). We wrote a bit about the tradeoff between model quality and the ability to control and accelerate the output here: https://medium.com/p/aa0395c31610

There are no comments on this comment yet.