Re:Microsoft is working on a Copilot Pro subscription (APK T...
by teruakohatu on Monday January 15, 2024 @12:36PM
(#39003611)
The trick is managing the context (number of tokens). It’s tempting to have a long conversation about tweaking some code, but a shorter context (last X messages), or ‘forking’ the conversation regularly can both improve performance and drastically lowers cost.
[ Parent
| on HN ]
Re:Microsoft is working on a Copilot Pro subscription (APK T...
by eurekin on Monday January 15, 2024 @12:43PM
(#39003689)
How do you go about that (besides manually editing the whole prompt)?
Re:Microsoft is working on a Copilot Pro subscription (APK T...
by blackoil on Monday January 15, 2024 @12:48PM
(#39003740)
Get GPT3.5 (10th cost) to summarize previous conversation after every few prompts or once conversation history reaches certain size. Once your history is 5k tokens bring it down to 500.