News for hackers. Stuff that matters.

tydunn

Re:Ask HN: Open source LLM-powered SQL tools? on Sunday December 10, 2023 @04:01PM (#38595005)
I have not used them, but the SQLCoder models look promising: https://github.com/defog-ai/sqlcoder
Re:Ask HN: Who is hiring? (December 2023) on Friday December 01, 2023 @02:49PM (#38491352)
Continue | Founding Engineer | ONSITE | Full-time | San Francisco | $130-$170K + 1-2% Equity

At Continue, we are on a mission to make building software feel like making music. We are creating the open-source autopilot for software development—an IDE extension that brings the power of ChatGPT to VS Code and JetBrains (https://github.com/continuedev/continue).

You are likely a good fit if you

- have founded or want to found your own startup one day

- have experience with frontend, backend, and ML technologies

- are enthusiastic about AI/LLMs, open source, developer tools

- get excited about supporting users and helping customers

- want to work in-person in SF the majority of the time

More info: https://www.ycombinator.com/companies/continue/jobs/smcxRnM-...

> RQ2 Findings: StarCoder generated more secure code than CodeGen-2B, CodeGen-2.5 7B, GPT-3.5 and GPT-4.

I wonder why StarCoder might generate more secure code

Re:One LLM won't rule them all on Friday November 03, 2023 @11:02AM (#38129843)
Reminded me of "Does One Large Model Rule Them All?" from earlier this year: https://maithraraghu.com/blog/2023/does-one-model-rule-them-...
Re:Language gaps constrain generative AI development on Thursday November 02, 2023 @12:55PM (#38116477)
I wonder if this is the same for programming languages too
Re:Ask HN: Who is hiring? (November 2023) on Wednesday November 01, 2023 @04:38PM (#38104804)
Continue | Founding Engineer | ONSITE | Full-Time | San Francisco | $130-$170K + 1-2% Equity

At Continue, we are on a mission to make building software feel like making music. We are creating the open-source autopilot for software development—an IDE extension that brings the power of ChatGPT to VS Code and JetBrains (https://github.com/continuedev/continue).

You are likely a good fit if you

- have founded or want to found your own startup one day

- have experience with frontend, backend, and ML technologies

- are enthusiastic about AI/LLMs, open-source, developer tools

- get excited about supporting users and helping customers

- want to work in-person in SF the majority of the time

More info: https://www.ycombinator.com/companies/continue/jobs/smcxRnM-...

This is awesome. Are you planning to open-source the V7 model?
This is a lot of tokens. Llama 2 was trained on two trillion tokens [1]

[1] https://arxiv.org/abs/2307.09288

Companies developing or demonstrating an intent to develop potential dual-use foundation models to provide the Federal Government, on an ongoing basis, with information, reports, or records ... (i) any model that was trained using a quantity of computing power greater than 10^26 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 10^23 integer or floating-point operations; and (ii) any computing cluster that has a set of machines physically co-located in a single datacenter, transitively connected by data center networking of over 100 Gbit/s, and having a theoretical maximum computing capacity of 10^20 integer or floating-point operations per second for training AI.

Training large models in the US now requires reporting

How have you tried to use them?
Re:The 'it' in AI models is the dataset on Friday October 27, 2023 @06:00PM (#38044562)
We seem to always be relearning this every few years: https://hbr.org/2021/07/ai-doesnt-have-to-be-too-complicated...
I've been surprised that evaluation dataset leakage into training dataset is not discussed more, given that LLM creators often don't reveal their training data
Re:Refreshing LLMs on Friday October 20, 2023 @03:40PM (#37960589)
This is awesome. Thanks for sharing!
Continue (disclaimer: I am a creator) is a VS Code extension that enables you to highlight a section of code or file and tell it to comment all of your functions and ensure that the typing is correct. Here is the point in our demo video where we show this: https://youtu.be/3Ocrc-WX4iQ?t=31. You could even create a custom slash command to do this if you do it frequently and want it done in the same specific way: https://continue.dev/docs/customization#custom-commands