Re:It looks like GPT-4-32k is rolling out
by int_19h on Saturday May 06, 2023 @04:56PM
(#35845294)
The raw chat log has the system message on top, plus "user:" and "assistant:" for each message, and im_start/im_end tokens to separate messages, hence why the visible chat context is slightly under 4k.
[ Parent
| on HN ]
There are no comments on this comment yet.