Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Dalai: Automatically install, run, and play with LLaMA on your computer. Parent comment
Technically you can by swapping to disk but it would be too slow to be usable.
What you can do however is use the 7B model with 4bit quantization and use it within 8GB RAM.
There are no comments on this comment yet.
Technically you can by swapping to disk but it would be too slow to be usable.
What you can do however is use the 7B model with 4bit quantization and use it within 8GB RAM.