News for hackers. Stuff that matters.

A comment on OpenAI Codex. Parent comment

Re:OpenAI Codex by nmca on Tuesday August 10, 2021 @05:10PM (#28134598)
12B, though. What about 1.2T?
[ Parent | on HN ]
Re:OpenAI Codex by lstmemery on Tuesday August 10, 2021 @05:26PM (#28134819)
You need to scale the amount of data to take advantage of the increase in parameters. I'm not sure where we would find another 100 GitHubs worth of data.
[ Parent | on HN ]