Re:Show HN: finetune LLMs via the Finetuning Hub
by Charon77 on Wednesday September 06, 2023 @07:22PM
(#37412744)
It's hardcoded, hidden within the code there are calls to huggingface's datasets.load_dataset, but you don't get to specify on your own..
[ Parent
| on HN ]
Re:Show HN: finetune LLMs via the Finetuning Hub
by rsaha7 on Wednesday September 06, 2023 @08:55PM
(#37413429)
Great observation. We are working on making this part very explicit. The goal was to let researchers get up to speed with the codebase to begin with, and then they would understand what needs to change to make these models work on custom datasets.
That being said, we are working on adding instructions to specify dataset and also the prompt that users want to use.