News for hackers. Stuff that matters.
Re:How to run Llama 13B with a 6GB graphics card by azeirah on Sunday May 14, 2023 @11:59AM (#35938928)
It's because vicuna is fine-tuned on chatGPT answers. LLaMa will not do this, but LLaMa-based models fine tuned with chatGPT answers will.
Re:How to run Llama 13B with a 6GB graphics card by fomine3 on Monday May 15, 2023 @01:58AM (#35944338)
Just curious why don't they training except denial responses. Is Copying ChatGPT ethics a purpose?
Re:How to run Llama 13B with a 6GB graphics card by jmiskovic on Monday May 15, 2023 @05:15AM (#35945518)
It's ongoing effort. At first they scrapped ShareGPT and used it to train the Alpaca model. After that others have pruned the dataset to remove examples where ChatGPT refused to answer. These datasets and resulting models are called "uncensored". They often leave disclaimer that the model is biased and unaligned, and that aligning should be done with LoRA layer.

Of course, no one bothered to this "ethics" LoRA so far and the unaligned models have better quality outputs than the early Alpaca models.