GPT-4 API General Availability

Re:GPT-4 API General Availability by londons_explore on Thursday July 06, 2023 @03:57PM (#36621905)

I think the clearest evidence is Microsofts paper where they show abilities at various stages during training[1]... But in a talk [2], they give more details... The unicorn gets worse during the finetuning process.

[2]: https://www.youtube.com/watch?v=qbIk7-JPB2c&t=1392s

[1]: https://arxiv.org/abs/2303.12712

[ Parent | on HN ]

Re:GPT-4 API General Availability by it_citizen on Thursday July 06, 2023 @04:04PM (#36622004)

Thanks, that’s interesting.

Noobie follow up question: Should we put any trust into “Sparks of intelligence” I thought it was regarded as a Microsoft marketing piece, not a serious paper.

[ Parent | on HN ]

Re:GPT-4 API General Availability by londons_explore on Thursday July 06, 2023 @04:05PM (#36622017)

The data presented is true... The text might be rather exaggerated/unscientific/marketing...

Also notable that the team behind that paper wasn't involved in designing/building the model, but they did get access to prerelease versions.

[ Parent | on HN ]

Re:GPT-4 API General Availability by ChatGTP on Thursday July 06, 2023 @05:49PM (#36623569)

I don’t trust it because enough third parties were able to verify the findings.

This is the double edge sword of being so ridiculously closed.

[ Parent | on HN ]