News for hackers. Stuff that matters.
Re:Building a personal, private AI computer on a budget by redman25 on Tuesday February 11, 2025 @09:41AM (#43013218)
Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
Re:Building a personal, private AI computer on a budget by blebo on Tuesday February 11, 2025 @10:12AM (#43013686)
Depends on quantization selected - see https://www.canirunthisllm.net/