News for hackers. Stuff that matters.

A comment on Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B.

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by ccding on Friday August 25, 2023 @09:31PM (#37269089)
Glad to see open source models becoming competitive and thanks for sharing the model to community! Lepton AI has hosted this model here free for everyone to give it a try (and compare to the original CodeLlama 34B version): https://codellama.lepton.run API is also available at https://codellama.lepton.run/api/v1 (it's fully compatible with OpenAI's api, so just switching the `api_base` to the this url and all your existing openai client side code should continue working)
[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by rushingcreek on Friday August 25, 2023 @09:34PM (#37269110)
I see you're using [INST] tokens. Please don't do this -- this model was not trained in this format or to be a chat model.

Instead, it should be treated as a completions model (like text-davinci-003) and no system prompt should be provided.

Just tell it what you want.

[ Parent | on HN ]
[dead]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by eshack94 on Wednesday August 30, 2023 @12:16AM (#37317587)
Hey, just an FYI, phind-codellama-34b-v2 was just released, which performs even better! Just letting you know in case you wanted to add the new model to the lepton chat you guys set up.
[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by eshack94 on Wednesday August 30, 2023 @12:18AM (#37317600)
Hey, just an FYI, phind-codellama-34b-v2 was just released, which performs even better! Just letting you know in case you wanted to add the new model too!
[ Parent | on HN ]