News for hackers. Stuff that matters.
Re:Structured Output from LLMs (Without Reprompting!) by beefnugs on Sunday July 16, 2023 @06:01PM (#36751839)
oh its 100% predictable alright, predictable to be garbage : the default example chooses height as the wrong "number" whatever that might assume to be, then if you try to change it to define height as perhaps "height in total inches" it still gets it wrong
Re:Structured Output from LLMs (Without Reprompting!) by sandkoan on Sunday July 16, 2023 @07:07PM (#36752333)
Ahh, that—due to compute limitations we're forced to run a very small model that isn't as capable of converting 5'8" to inches. The larger model is, though.