News for hackers. Stuff that matters.
Re:It looks like GPT-4-32k is rolling out by int_19h on Saturday May 06, 2023 @04:56PM (#35845294)
The raw chat log has the system message on top, plus "user:" and "assistant:" for each message, and im_start/im_end tokens to separate messages, hence why the visible chat context is slightly under 4k.

There are no comments on this comment yet.