/me pours one out for neural scaling laws
Did you read and somehow fail to understand the chinchilla paper?
Do you believe the amount of available training data has stopped growing?
Shouldn't it correlate pretty strongly with price? Like, model size is literally the amount of memory / compute it takes to elect each token.
Agree there is no direct relation to quality - a Fable whose weights have been totally randomized would be the same size and cost the same amount to run.
It doesn’t correlate with intelligence, speed or price furthermore you have no way of telling what the model sizes of “like for like” named models from oai or Anthropic are.