Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat...
by alchemist1e9 on Tuesday March 28, 2023 @09:12PM
(#35350677)
That sounds promising but how about the quality of the output.
I’ve been using OpenAI API with chatblade and been giving it code in various languages and it’s quite surprising how well it describes the purpose and code implementation in english. The english description would be useful and relevant for developers trying to quickly familiarize themselves with a code base.
For a typical 400-600 line file it looks like it would cost around 1-3 cents per file. However loss of privacy isn’t so great.
How do you find output quality of llama + lora for such a task?
I’ve been using OpenAI API with chatblade and been giving it code in various languages and it’s quite surprising how well it describes the purpose and code implementation in english. The english description would be useful and relevant for developers trying to quickly familiarize themselves with a code base.
For a typical 400-600 line file it looks like it would cost around 1-3 cents per file. However loss of privacy isn’t so great.
How do you find output quality of llama + lora for such a task?
Code is research code I’d run it on.