Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week

Re:Replit's new Code LLM: Open Source, 77% smaller than Code... by kir-gadjello on Wednesday May 03, 2023 @09:39PM (#35810253)

It is a guess informed by some familiarity with the literature and by going over the papers authored by researchers credited in the OpenAI's "GPT-4 contributors" web page.

I have an expanded list of foundational research that is likely to serve as basis for gpt4 here in my blog: https://kir-gadjello.github.io/posts/gpt4-some-technical-hyp...

Hope it helps!

[ Parent | on HN ]

Re:Replit's new Code LLM: Open Source, 77% smaller than Code... by blueblimp on Thursday May 04, 2023 @12:02AM (#35811043)

Interesting resource. I had been wondering whether anyone had tried to compile such a list.

[ Parent | on HN ]

Re:Replit's new Code LLM: Open Source, 77% smaller than Code... by swyx on Thursday May 04, 2023 @03:04AM (#35812194)

thank you! glad i asked

[ Parent | on HN ]