News for hackers. Stuff that matters.

A comment on ChatGPT's 1-Year Anniversary: Are Open-Source Large Language Models Catching Up?. Parent comment

Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by infecto on Friday December 01, 2023 @09:19AM (#38486940)
I don't think think using examples derived from ChatGPT are a fair comparison to the underlying models. OpenAI has many optimization tricks on the ChatGPT side that are unrelated to the underlying models being used.

We do know of course that ChatGPT is most likely using 4-Turbo from the decrease in latency and increase in unhelpful answers.

We cannot say that the models are "converging down" though. I don't remember the marketing materials but from the model side we all realize that the Turbo models have some type of quantization/optimization that makes them cheap and fast. 4-Turbo is 3x cheaper than 4, substantially quicker and provides better results than 3.5-Turbo. Amazing progress in my arena.

[ Parent | on HN ]
Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by Workaccount2 on Friday December 01, 2023 @10:47AM (#38488110)
There were many rumors (and it probably was true) that OpenAI was hemorrhaging cash on GPT4 requests. So it makes tons of sense for them to sprint towards a turbo model at the expense of some ability. GPT4-turbo still is ridiculously powerful anyway.
[ Parent | on HN ]