News for hackers. Stuff that matters.
Re:Ollama releases OpenAI API compatibility by nl on Thursday February 08, 2024 @06:51PM (#39309444)
and what does `auto` even mean?
Re:Ollama releases OpenAI API compatibility by athyuttamre on Friday February 09, 2024 @05:56AM (#39313572)
Hey nl — I work at OpenAI on our API. Do you mean `tool_choice="auto"`? If so, it means the model gets to pick which tool to call. The other options are:

- `tool_choice={type: "function", function: {name: "getWeather"}}`, where the developer can force a specific tool to be called. - `tool_choice="none"`, where the developer can force the model to address the user, rather than call a tool.

If you have any other feedback, please feel free to email me at [email protected]. Thanks!