Re:Jsonformer: A bulletproof way to generate structured outp...
by ianbutler on Tuesday May 02, 2023 @05:39PM
(#35794591)
* * *
[ Parent
| on HN ]
Re:Jsonformer: A bulletproof way to generate structured outp...
by killthebuddha on Tuesday May 02, 2023 @09:41PM
(#35796660)
I think I agree, and am doing something similar as well. Even the adapters approach does require some amount of consistency across prompts. For example, if you have one prompt that says “you are a very helpful assistant” and one prompt that says “you are a very lazy assistant”, then even if those prompts are otherwise written to be as orthogonal as possible you will still probably see degradation in completion quality.