Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size

Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and... by howon92 on Monday September 04, 2023 @01:10PM (#37382483)

Congrats on your achievement! I'm curious about your end goal. Do you aim to beat GitHub Copilot's performance and convince devs to use Refact for code completion instead of GitHub Copilot? I want to understand the motivation behind these different code-completion models that are not solely for academic research.

[ Parent | on HN ]

Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and... by OlegKlimov1337 on Monday September 04, 2023 @01:26PM (#37382695)

You can use it in practice, that was the goal of that particular model! It's fast, runs on your own hardware if you want it to.

[ Parent | on HN ]

Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and... by kateklink on Monday September 04, 2023 @01:24PM (#37382679)

we want to help developers who need either on-premise or permissive code assistant, copilot has neither of this. We also wanted to lower the barriers for self-hosting, so that the model is available on most GPUs with just 3GB Ram. Plus making the code completions fast and efficient (understanding entire context, not just the previous tokens).

[ Parent | on HN ]