Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with...
by IanCal on Monday March 13, 2023 @04:39PM
(#35142195)
That dataset isn't released yet.
> Can I download the data?
> You will be able to, under CC BY 4.0, but it's not released yet. We want to remove spam and PII before releasing it.
Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with...
by losteric on Monday March 13, 2023 @05:11PM
(#35142734)
There's the OIG dataset (https://laion.ai/blog/oig-dataset/) which was used to train a NeoX 20B ChatBot (https://huggingface.co/togethercomputer/GPT-NeoXT-Chat-Base-...). The dataset is larger and publicly available. I want to try finetuning LLaMa on this tonight.
I'm not sure why the authors of Alpaca didn't try to train it on this dataset.