News for hackers. Stuff that matters.
Re:How to run Llama 13B with a 6GB graphics card by fomine3 on Monday May 15, 2023 @01:58AM (#35944338)
Just curious why don't they training except denial responses. Is Copying ChatGPT ethics a purpose?
Re:How to run Llama 13B with a 6GB graphics card by jmiskovic on Monday May 15, 2023 @05:15AM (#35945518)
It's ongoing effort. At first they scrapped ShareGPT and used it to train the Alpaca model. After that others have pruned the dataset to remove examples where ChatGPT refused to answer. These datasets and resulting models are called "uncensored". They often leave disclaimer that the model is biased and unaligned, and that aligning should be done with LoRA layer.

Of course, no one bothered to this "ethics" LoRA so far and the unaligned models have better quality outputs than the early Alpaca models.