Re:Teaching ChatGPT to Speak My Son’s Invented Language
by og_kalu on Monday April 10, 2023 @06:17PM
(#35518051)
The limits of the context window become much less important (but can still be a problem I agree) when crucial context can be dynamically inserted only when relevant.
Gpt-3.5 doesn't need the algorithm prompt for every single query. It just needs it for every query that requires arithmetic. Much more feasible.
You can't do it for everything, but if you can generate code and run it outside the LLM, you should.