News for hackers. Stuff that matters.
Re:ChatML: ChatGPT API expects a structured format, called C... by creatonez on Wednesday March 01, 2023 @06:12PM (#34989673)
Why do you think Bing Chat is going in a slightly different direction and not using this format exactly?

Their prompt - https://old.reddit.com/r/bing/comments/11bd91j/release_of_th...

Wouldn't it be better to unify around ChatML, for the sake of all future training data being consistent? I thought it was strange that they used <|im_start|> but not the rest of the ChatML syntax.

(There is always the possibility that they are using it, but the AI has hallucinated a slightly different syntax when repeating it)

Re:ChatML: ChatGPT API expects a structured format, called C... by notamy on Wednesday March 01, 2023 @06:52PM (#34990050)
I'm VERY curious about those "#inner_monologue" sections...
Re:ChatML: ChatGPT API expects a structured format, called C... by gs17 on Wednesday March 01, 2023 @07:12PM (#34990218)
Looks like it's just getting it to "show its work" to improve the output.
Re:ChatML: ChatGPT API expects a structured format, called C... by int_19h on Wednesday March 01, 2023 @10:51PM (#34991773)
Telling ChatGPT to "think it out loud" first before giving the final answer generally leads to better results than just telling it to answer right away. This is especially true in multi-step tasks where you keep adding to input.
Re:ChatML: ChatGPT API expects a structured format, called C... by rentnorove on Wednesday March 01, 2023 @07:26PM (#34990347)
Platform lock-in. Interoperability would not only be more costly in terms of the work to design and agree on a common standard, but it'd also makes it easier to switch to a competitor.
Re:ChatML: ChatGPT API expects a structured format, called C... by creatonez on Sunday March 05, 2023 @10:56PM (#35037355)
> but it'd also makes it easier to switch to a competitor.

Thing is, the end user never sees this implementation detail, so it only matters on their side.

Re:ChatML: ChatGPT API expects a structured format, called C... by shepardrtc on Thursday March 02, 2023 @07:10AM (#34994769)
Microsoft has always been very siloed. They want to do their own thing with it - as evidenced by the pile of hot garbage they've turned it into.