News for hackers. Stuff that matters.
Re:Microsoft is working on a Copilot Pro subscription (APK T... by teruakohatu on Monday January 15, 2024 @12:36PM (#39003611)
The trick is managing the context (number of tokens). It’s tempting to have a long conversation about tweaking some code, but a shorter context (last X messages), or ‘forking’ the conversation regularly can both improve performance and drastically lowers cost.
Re:Microsoft is working on a Copilot Pro subscription (APK T... by eurekin on Monday January 15, 2024 @12:43PM (#39003689)
How do you go about that (besides manually editing the whole prompt)?
Re:Microsoft is working on a Copilot Pro subscription (APK T... by blackoil on Monday January 15, 2024 @12:48PM (#39003740)
Get GPT3.5 (10th cost) to summarize previous conversation after every few prompts or once conversation history reaches certain size. Once your history is 5k tokens bring it down to 500.
Re:Microsoft is working on a Copilot Pro subscription (APK T... by eurekin on Monday January 15, 2024 @01:01PM (#39003925)
Oh! That's actually cool. Could use that mixtral on the next pc as well