News for hackers. Stuff that matters.

A comment on ChatGPT's 1-Year Anniversary: Are Open-Source Large Language Models Catching Up?. Parent comment

Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by bugglebeetle on Thursday November 30, 2023 @11:04PM (#38482994)
Function-calling with a JSON schema is about as reliable as llama.cpp’s grammar stuff. I’ve not had any trouble with it.
[ Parent | on HN ]
Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by infecto on Friday December 01, 2023 @09:22AM (#38486969)
The only thing I would argue is that JSON generation and function calling have noticeable decrease in quality of output in certain uses. I have had a hard time writing tests to measure it but its noticeable for my human eyes when I compare various implementations I have written.
[ Parent | on HN ]