To make it with davinci-003 you can store all the conversation history and prefix it to your prompt as you mentioned. It does mean that you're limited to a history of about 3.5k words, which you could summarize into a smaller chunk to help make the conversations longer. I have a basic demo of a chatbot that remembers here:

github.com/dylnbk/chatty