Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Open source ChatGPT with LLaMA implementation trains 15x faster. Parent comment
The perf of a model of that size on the M1 will not be good. That is big enough it won't quite fit on a 3090 (24GB) without quantization.
There are no comments on this comment yet.
The perf of a model of that size on the M1 will not be good. That is big enough it won't quite fit on a 3090 (24GB) without quantization.