Re:Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing
by rsaha7 on Monday April 08, 2024 @05:34PM
(#39973961)
Great question.
Right now, the roadmap includes extending the training optimizer sections to include techniques beyond LoRA.
Furthermore, the testing suite will be extended to add more unit-tests that are task dependent.
I know that other repositories exist with similar functionalities but they can be too low level for the day-to-day data scientist to understand. Also, there are several repositories that are too specific for either testing, fine-tuning, etc. Our repository consolidates the most critical aspects of running fine-tuning experiments while being lightweight for anyone to understand and play with.
Right now, the roadmap includes extending the training optimizer sections to include techniques beyond LoRA.
Furthermore, the testing suite will be extended to add more unit-tests that are task dependent.
I know that other repositories exist with similar functionalities but they can be too low level for the day-to-day data scientist to understand. Also, there are several repositories that are too specific for either testing, fine-tuning, etc. Our repository consolidates the most critical aspects of running fine-tuning experiments while being lightweight for anyone to understand and play with.