The trick is managing the context (number of tokens). It’s tempting to have a long conversation about tweaking some code, but a shorter context (last X messages), or ‘forking’ the conversation regularly can both improve performance and drastically lowers cost.

How do you go about that (besides manually editing the whole prompt)?

Get GPT3.5 (10th cost) to summarize previous conversation after every few prompts or once conversation history reaches certain size. Once your history is 5k tokens bring it down to 500.

Oh! That's actually cool. Could use that mixtral on the next pc as well

$10 lasting two weekends sounds about right for a $20/month product?

I'm using the chatgpt sometimes 2-3 hours a day. That could easily go 10x

Use the gpt4-turbo-preview it's 10x less expensive.