Re:Testing ability of GPT4 and open-source LLMs to detect C+...
by fhd2 on Sunday April 16, 2023 @02:11AM
(#35587698)
Presumably. Vicuna was fine-tuned on ChatGPT responses, but from a quick glance through the examples in the blog post, there are none asking it to find a bug: https://vicuna.lmsys.org/
I've found Vicuna 13B to be quite capable at _generating_ code. But not as good as GPT-4. Model size probably also plays a large role: 13B parameters runs nicely on normal-ish home user hardware, GPT-4 not quite.
I've found Vicuna 13B to be quite capable at _generating_ code. But not as good as GPT-4. Model size probably also plays a large role: 13B parameters runs nicely on normal-ish home user hardware, GPT-4 not quite.