News for hackers. Stuff that matters.
Re:OpenAI: Streaming is now available in the Assistants API by msp26 on Thursday March 14, 2024 @06:27AM (#39702157)
Hey, random question.

Is there a technical reason why log probs aren't available when using function calling? It's not a problem, I've already found a workaround. I was just curious haha.

In general I feel like the function calling/tool use is a bit cumbersome and restrictive so I prefer to write the typescript in the functions namespace myself and just use json_mode.

Re:OpenAI: Streaming is now available in the Assistants API by rattray on Thursday March 14, 2024 @04:41PM (#39708712)
Have you seen/tried the `.runTools()` helper?

Docs: https://github.com/openai/openai-node?tab=readme-ov-file#aut...

Example: https://github.com/openai/openai-node/blob/bb4bce30ff1bfb06d...

(if what you're fundamentally trying to do is really just get JSON out, then I can see how json_mode is still easier).