tmptmptmp1
Re:Open source ChatGPT with LLaMA implementation trains 15x faster
on Monday February 27, 2023 @12:22PM (#34959171)
Do you have access to the weights? If so you probably have better ML hardware. Wish this model was actually "open".
The perf of a model of that size on the M1 will not be good. That is big enough it won't quite fit on a 3090 (24GB) without quantization.