News for hackers. Stuff that matters.

A comment on Introducing ChatGPT and Whisper APIs. Parent comment

Re:Introducing ChatGPT and Whisper APIs by habitue on Wednesday March 01, 2023 @07:18PM (#34990263)
I just meant chinchilla optimal in terms of the corrected scaling curves from the chinchilla paper. The original GPT-3 was way larger than it needed to be for the amount of data they put into it based on the curves from the chinchilla paper.
[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by cubefox on Thursday March 02, 2023 @01:09AM (#34992580)
It's also worth noting that we don't know any specifics (parameters, training tokens) of GPT-3.5. Only for GPT-3 those numbers have been published.
[ Parent | on HN ]