News for hackers. Stuff that matters.

A comment on Next-generation AI models. Parent comment

Re:Next-generation AI models by BrandonJung on Wednesday June 22, 2022 @07:50AM (#31834810)
Cost wise the biggest spend is building the large model (CODEX for Copilot). While CODEX is close sourced there are a number of other good open source transformer models from SFDC (T5), AI21, Meta that are the foundational models we use. Going forward we will continue to partner with the community to enable these large models to reach developers in code-time.
[ Parent | on HN ]
Re:Next-generation AI models by superasn on Wednesday June 22, 2022 @11:37PM (#31844931)
Just out of curiosity since you are so knowledgeable in this area.. what would be like a very approx ballpark figure to develop something like codex?
[ Parent | on HN ]
Re:Next-generation AI models by BrandonJung on Thursday June 23, 2022 @10:34AM (#31849667)
Ballpark guess is that to build CODEX it would be ~$10M.
[ Parent | on HN ]