Re:GPT-4 Details Leaked
by rjb7731 on Tuesday July 11, 2023 @02:29AM
(#36677119)
I've previously noticed when playing with GPT-4 it can sometimes 'autocomplete' on different sections of the text its feeding back, sometimes what looks like 4 or more different sections. Might be unrelated but is this MoE in action or them streaming the response in some way?
[ Parent
| on HN ]
Re:GPT-4 Details Leaked
by LiamPowell on Tuesday July 11, 2023 @02:48AM
(#36677260)
This is just an issue with their frontend that seems to occur when it encounters \n\n. The actual data coming in only changes at the end of the message.