Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by praveenhm on Saturday August 26, 2023 @01:00AM (#37270069)

Is reverse a linked list is still a popular question on interview?

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by ddalex on Saturday August 26, 2023 @02:43AM (#37270403)

I ask it as a warmup question, I expect it to be done in 5-10 minutes.

Then comes the real question, which is "let's write fizz buzz so it generates at above 55Gbytes/second".

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by moffkalast on Saturday August 26, 2023 @05:55AM (#37271211)

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by robinson7d on Saturday August 26, 2023 @06:19AM (#37271396)

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by moffkalast on Saturday August 26, 2023 @08:21AM (#37272164)

Ah, lmao

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by redox99 on Saturday August 26, 2023 @08:01AM (#37272014)

Kind of hilarious what it would go for Python, of all languages.

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by pmarreck on Saturday August 26, 2023 @09:24AM (#37272672)

I explicitly instructed in my custom instructions to never use Python, Go or JS, and to stick to functional languages. Works a treat.

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by madduci on Saturday August 26, 2023 @07:46AM (#37271900)

just out of curiosity, how performed the candidates on real tasks on the job then?

[ Parent | on HN ]

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by fb03 on Saturday August 26, 2023 @08:05AM (#37272043)

I got that fizzbuzz reference. Stack Overflow thread right?

[ Parent | on HN ]