News for hackers. Stuff that matters.

A comment on Anthropic launches Tool Use (function calling). Parent comment

Re:Anthropic launches Tool Use (function calling) by logicchains on Friday April 05, 2024 @05:26AM (#39940423)
Open LLMs can use grammar-based sampling to guarantee syntactically correct JSON is produced, surprised OpenAI never incorporated anything like that.
[ Parent | on HN ]
Re:Anthropic launches Tool Use (function calling) by rolisz on Friday April 05, 2024 @07:22AM (#39941029)
my concern with grammar based sampling is that it makes the model dumber: after all, you are forcing it to say something else than what it thought would be best.
[ Parent | on HN ]
Re:Anthropic launches Tool Use (function calling) by remilouf on Friday April 05, 2024 @01:19PM (#39944856)
Looks like it’s quite the opposite: http://blog.dottxt.co/performance-gsm8k.html
[ Parent | on HN ]