kateklink
kateklink on Hacker News
Posted by
kateklink on Tuesday November 21, 2023 @07:07AM
from the github.com dept.
for pass@1 HumanEval tells how well the model solves a task from a set, given only one chance to solve it. It's not the perfect metric, there're other like DS-1000, MBPP (we have included them on HuggingFace model card). HumanEval is good for benchmarking with other models as it gives a fast idea how powerful the model is.
we want to help developers who need either on-premise or permissive code assistant, copilot has neither of this. We also wanted to lower the barriers for self-hosting, so that the model is available on most GPUs with just 3GB Ram. Plus making the code completions fast and efficient (understanding entire context, not just the previous tokens).
We’ve finished training a new code model Refact LLM which took us about a month. The main use-case is for blazing-fast code completion with fill-in-the-middle, additionally, the model could reply to chat prompts.
It has much better performance than all of the code models of similar size, and almost reaches the same HumanEval as Starcoder being 10x smaller in size.
With the small size, it can work with most modern GPUs requiring just 3GB Ram.
You can try self-hosting it in Refact https://github.com/smallcloudai/refact/ and get a local fast copilot alternative with decent suggestions.
Weights and model card https://huggingface.co/smallcloudai/Refact-1_6B-fim.
We would love to hear your feedback!
Posted by
kateklink on Monday September 04, 2023 @12:13PM
from the refact.ai dept.
having more plugin support is in our plans for sure. We're also open for contributions.
we try to eliminate this problem by using code models trained only on permissevely licensed code, then you can run them locally without sending code anywhere
we're going in this direction for code models with Refact
https://github.com/smallcloudai/refact/ - right now you self-host code models, fine-tune them on local files, get the model running locally inside your IDE
at refact.ai we have different functions for code refactoring, making it shorter, simplifying complexity, etc
Refact.Ai |
https://refact.ai | Developer Advocate | Remote (UK & Europe) | 80 - 120K + equity
We're building the best open-source AI for coding using all the best LLMs available in the internet (GPT, Starcoder, WizardCoder, LLama2).
We’re hiring for Refact’s first Developer Advocate. As the first Developer Advocate, you'll play a key role in helping developers use the power of AI for coding. You'll have the opportunity to grow and support a community of developers who are excited about the future of AI and open-source.
Apply: https://wellfound.com/recruit/jobs/2703005
Posted by
kateklink on Friday July 28, 2023 @12:23PM
from the refact.ai dept.
Hi HN! At Refact, we're building an open-source AI Code assistant with fine-tuning focused on providing the enjoyable coding experience without privacy concerns.
Why? When you look at AI code tools like Copilot, you'll notice that they often provide generic coding suggestions because the models were not trained on your codebase. They also only work in the cloud, so in order to get a code suggestion, you need to send your code to the cloud provider.
One of the solutions for this is self-hosted fine-tuning on codebase, but the companies who provide this feature currently prioritize it for enterprise making it difficult for individual devs to use it.
We want to change that by open-sourcing fine-tuning for everyone, not just enterprise customers.
Currently with Refact you can self-host Refact models and the best open-source LLMs (like StarCoder, LLama2, WizardLM) and use it for code suggestions and chat.
We would love to hear your ideas and feedback on your current experience with AI code assistants and what is currently missing!
Posted by
kateklink on Friday July 28, 2023 @10:38AM
from the github.com dept.
Posted by
kateklink on Thursday July 27, 2023 @11:58AM
from the github.com dept.
Refact is a free open-source AI code assistant for VS Code and Jetbrains.
Under the hood, we use the best open-source LLMs for code completion, chat inside IDE and code transformations (refactoring, bug fixing and more).
You can also run self-hosted fine-tuning to get suggestions tailored to your codebase.
Posted by
kateklink on Friday May 26, 2023 @07:14AM
from the refact.ai dept.
Refact.ai as a free copilot alternative
while you're waiting, maybe you'll be interested in checking
https://refact.ai it's an open-source alternative to Copilot X with features like code transformation and integrated chat on top of code completion
if you're interested in VS Code plugin you may wanna try Refact.ai (which also has a self-hosted option)
hi! We've actually done it at Refact.ai, would be glad to hear your feedback.
We never store the code. Your code is only used for inference on our servers, not for learning. And in the case of self-host it never leaves your premises.
Posted by
kateklink on Friday March 31, 2023 @11:36AM
from the show-hn dept.
https://refact.ai/blog/2023/introducing-refact-ai/
Refact is a Copilot alternative that has an autocomplete, integrated AI chat and powerful editing. We use our own models that are fine-tuned for each language, they are smaller than the one in Copilot, but are very powerful for their size. On certain tasks, you will not notice much difference: the model look up and down, and the context window is the same.Try it for free for JetBrains and VS Code.
We've recently launched
https://refact.ai it's an AI assistant for VS Code and JetBrains that helps with refactoring old code and generating new one. It's powered by our own AI model and Python shows one of the best results.
Neon now support PostgreSQL 15.
PostgreSQL 15 includes improved sort performance, write-ahead log (WAL) file compression, and other improvements. Here are some features you can try using Neon’s SQL Editor.