It may just be that OpenAI corrected its 2020-era understanding of model size using 2022 insights from DeepMind.. https://towardsdatascience.com/a-new-ai-trend-chinchilla-70b...

Seems model sizing, compression and quantization are still an art form, see also https://www.unum.cloud/blog/2023-02-20-efficient-multimodali...