News for hackers. Stuff that matters.
Re:GitHub Copilot is now available for free by thot_experiment on Wednesday December 18, 2024 @04:15PM (#42455318)
100% disagree with this take, the flexibility in controlling the prompt leads to QwenCoder2.5-32b outperforming gpt-o1 and claude sonnet 3.5 for nearly everything that I use it for (true for Gemma-27b and llama3.3-70b, though in this context I'm almost always using the former). A specialist model that's specifically prompted to do the correct thing will outperform a SOTA generic model with a one size fits all system prompt. This is why small autocomplete models can very obviously outperform larger models at that specific task. I am speaking 100% from experience and ignore all benchmarks in forming this view btw, so maybe it's just my specific situation.

Also, in general I don't find the difference between SOTA models and local models to be that significant in the real world even when used in the exact same way.

Re:GitHub Copilot is now available for free by k__ on Wednesday December 18, 2024 @05:01PM (#42455927)
Sounds great.

Does this run with VSCode and how hard is it to set this up?

Re:GitHub Copilot is now available for free by thot_experiment on Wednesday December 18, 2024 @05:21PM (#42456120)
yes, the vscode extension is a one click install, so is ollama which is a separate project that provides local inference

you'll then have to download a model, which ollama makes very easy. choosing which one will depend on your hardware but the biggest QwenCoder2.5 you can fit is a very solid starting place. it's not ready for your grandma, but it's easy enough that I'd trust a junior dev to be able to get it done

Re:GitHub Copilot is now available for free by k__ on Thursday December 19, 2024 @05:37PM (#42466460)
What's the extension name?
Re:GitHub Copilot is now available for free by thot_experiment on Thursday December 19, 2024 @06:38PM (#42466897)
Continue, I talk about it at length in the gp post.
Re:GitHub Copilot is now available for free by k__ on Thursday December 19, 2024 @07:49PM (#42467278)
Ah, thanks.

I just read the parent post, lol.

Re:GitHub Copilot is now available for free by edm0nd on Wednesday December 18, 2024 @08:25PM (#42457377)
Are there any small trained models out there that are specifically for python programming that you know of?
Re:GitHub Copilot is now available for free by grandma_tea on Wednesday December 18, 2024 @08:35PM (#42457442)
Do you have any example prompts or suggestions for coming up with them?