Re:OpenAI Function calling and API updates
by civilitty on Tuesday June 13, 2023 @01:43PM
(#36313803)
Or there’s a trade off between more complex schemas and logit bias going off the rails since there’s probably little to no backtracking.
[ Parent
| on HN ]
Re:OpenAI Function calling and API updates
by newhouseb on Tuesday June 13, 2023 @10:55PM
(#36320854)
Good point. Backtracking is certainly possible but it is probably tricky to parallelize at scale if you're trying to coalesce and slam through a bunch of concurrent (unrelated) requests with minimal pre-emption.