A simple guide to fine-tuning Llama 2

Re:A simple guide to fine-tuning Llama 2 by eachro on Monday July 24, 2023 @04:41PM (#36853906)

I've veen a bit out of the loop on this area but would like to get back into it given how much has changed in the LLM landscape in the last 1-2 yrs. What models are small enough to play with on Collab? Or am I going to have to spin up my own gpu box on aws to be able to mess around with these models?

[ Parent | on HN ]

Re:A simple guide to fine-tuning Llama 2 by naderkhalil on Monday July 24, 2023 @05:19PM (#36854346)

Hey, you could use a template on brev.dev to spin up a gpu box with the model and Jupyter notebook. Alternatively, the falcon 7b model should be small enough for colab

[ Parent | on HN ]

Re:A simple guide to fine-tuning Llama 2 by ramesh31 on Monday July 24, 2023 @06:31PM (#36855162)

Two years is eons with this stuff. Things are changing weekly. You can run inference with Llama-2-7B on a Macbook.

[ Parent | on HN ]