I've seen Altman say in an interview that training GPT-4 took "hundreds of little things".

I don't find this implausible, but it folds slightly to Ockham's razor when you consider that this is the exact type of statement that would be employed to obfuscate a major breakthrough.

It just makes me crook my eyebrow and look to more credible sources.