Re:A guidance language for controlling LLMs
by harshhpareek on Tuesday May 16, 2023 @05:59PM
(#35968326)
10% failure rate is too damn high for a production use case.
What production use case, you ask? You could do zero-shot entity extraction using ChatGPT if it were more reliable. Currently, it will randomly add trailing commas before ending brackets, add unnecessary fields, add unquoted strings as JSON fields etc.
It does fail roughly 1/10th of the time, but it does work.