Re:Ollama releases OpenAI API compatibility
by athyuttamre on Friday February 09, 2024 @05:56AM
(#39313572)
Hey nl — I work at OpenAI on our API. Do you mean `tool_choice="auto"`? If so, it means the model gets to pick which tool to call. The other options are:
- `tool_choice={type: "function", function: {name: "getWeather"}}`, where the developer can force a specific tool to be called.
- `tool_choice="none"`, where the developer can force the model to address the user, rather than call a tool.
If you have any other feedback, please feel free to email me at [email protected]. Thanks!
- `tool_choice={type: "function", function: {name: "getWeather"}}`, where the developer can force a specific tool to be called. - `tool_choice="none"`, where the developer can force the model to address the user, rather than call a tool.
If you have any other feedback, please feel free to email me at [email protected]. Thanks!