News for hackers. Stuff that matters.

A comment on Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B. Parent comment

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by rushingcreek on Friday August 25, 2023 @09:34PM (#37269110)
I see you're using [INST] tokens. Please don't do this -- this model was not trained in this format or to be a chat model.

Instead, it should be treated as a completions model (like text-davinci-003) and no system prompt should be provided.

Just tell it what you want.

[ Parent | on HN ]
[dead]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by eshack94 on Wednesday August 30, 2023 @12:16AM (#37317587)
Hey, just an FYI, phind-codellama-34b-v2 was just released, which performs even better! Just letting you know in case you wanted to add the new model to the lepton chat you guys set up.
[ Parent | on HN ]