News for hackers. Stuff that matters.
Re:Fine-Tuning Llama-2: A Comprehensive Case Study for Tailo... by praveenhm on Friday August 11, 2023 @06:07PM (#37094657)
Is this possible to fine tune llama-2 locally on M1 Ultra 64GB, I would like to know or any pointer would be good. Most of them are on Cloud or using Nvidia Cuda on linux.
Re:Fine-Tuning Llama-2: A Comprehensive Case Study for Tailo... by aldarisbm on Friday August 11, 2023 @07:21PM (#37095224)
I don't think so. I have M1 Max 64GB and it works okay for some inference. I'm buying a few credits from RunPod. It will be a few 10's of dollars to get it trained.