threepi
Re:Exploring LoRA – Part 1: The Idea Behind Parameter Efficient Fine-T...
on Tuesday December 24, 2024 @11:20PM (#42506799)
Author here. Happy to see this posted here. This is actually a series of blog posts:
1. Exploring LoRA — Part 1: The Idea Behind Parameter Efficient Fine-Tuning and LoRA: https://medium.com/inspiredbrilliance/exploring-lora-part-1-...
2. Exploring LoRA - Part 2: Analyzing LoRA through its Implementation on an MLP: https://medium.com/inspiredbrilliance/exploring-lora-part-2-...
3. Intrinsic Dimension Part 1: How Learning in Large Models Is Driven by a Few Parameters and Its Impact on Fine-Tuning https://medium.com/inspiredbrilliance/intrinsic-dimension-pa...
4. Intrinsic Dimension Part 2: Measuring the True Complexity of a Model via Random Subspace Training https://medium.com/inspiredbrilliance/intrinsic-dimension-pa...
Hope you enjoy reading the other posts too. Merry Christmas and Happy Holidays!