Meta is inviting researchers to pick apart the flaws in its version of GPT-3

Re:Meta is inviting researchers to pick apart the flaws in i... by sanxiyn on Monday June 27, 2022 @07:44PM (#31902397)

If you are interested in hot-swapping, I highly recommend OpenAI Five paper: https://arxiv.org/abs/1912.06680. It includes 10 months log of how they adapted the model to releases of Dota 2 version 7.19, 7.20, and 7.21.

I agree hot-swapping is underreported, but there are some good existing reports. In fact, OpenAI Five paper today is probably more valuable for its details on hot-swapping than its details on main model which used LSTM and not transformer.

[ Parent | on HN ]

Re:Meta is inviting researchers to pick apart the flaws in i... by hoseja on Tuesday June 28, 2022 @01:49AM (#31904530)

Weird they felt the need to update the version since they used a very limited subset of Dota anyway.

[ Parent | on HN ]