News for hackers. Stuff that matters.
Re:New tools and features in the Responses API by brittlewis12 on Wednesday May 21, 2025 @12:50PM (#44053401)
chat completions is stateless — you must provide the entire conversation history with each new message; openai stores nothing (at least nothing that the downstream product _can use_) beyond the life of the request.

responses api, by contrast, is stateful — only send the latest message, and openai stores the conversation history, while keeping track of other details on behalf of the calling app, like parallel tool call states.

but i would say that since chat completions has become an informal industry standard, the responses api feels like an attempt by openai to break away from that shared interface, because it is so easy to swap out providers with nothing more than a base url and a model id, to a paradigm which requires data migration as well as replacement infrastructure (containers for code execution, for example).

Re:New tools and features in the Responses API by nknj on Wednesday May 21, 2025 @01:20PM (#44053763)
one additional difference between chat and responses is the number model turns a single api call can make. chat completions is a single turn api primitive -- which means it can talk to the model just once. responses is capable of making multiple model turns and tool calls in a single api call.

for example, you can give the responses api access to 3 tools: a vector store with some user memories (file_search), the shopify mcp server, and code_interpreter. you can then ask it to look up some user memories, find relevant items in the shopify mcp store, and then download them into a csv file. all of this can be done in a single api call that involves multiple model turns and tool calls.

p.s. - you can also use responses statelessly by setting store=false.

Re:New tools and features in the Responses API by swyx on Wednesday May 21, 2025 @01:55PM (#44054216)
i think the original intent of responses api was also to unify the realtime experiences into responses - is that accurate?
Re:New tools and features in the Responses API by nknj on Thursday May 22, 2025 @12:05AM (#44058687)
we expect responses and realtime to be our 2 core api primitives long term — responses for turn by turn interactions and realtime for models requiring low latency bidirectional streams to/from the apps/models.
Re:New tools and features in the Responses API by swyx on Thursday May 22, 2025 @01:28PM (#44064375)
thank you for the correction!
Re:New tools and features in the Responses API by OutOfHere on Wednesday May 21, 2025 @01:48PM (#44054136)
What are my choices for using a custom tool? Does it come down to: function calling (single turn), MCP (multi-turn via Responses)? What else are my choices?

Why would anyone want to use Responses statelessly? Just trying to understand.

Re:New tools and features in the Responses API by andrewrn on Saturday May 24, 2025 @02:05PM (#44082779)
This is very enlightening. You're right then, it does seem to partially be a strategic moat-building move by OpenAI