Re:Building a personal, private AI computer on a budget
by redman25 on Tuesday February 11, 2025 @09:41AM
(#43013218)
Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
[ Parent
| on HN ]
Re:Building a personal, private AI computer on a budget
by blebo on Tuesday February 11, 2025 @10:12AM
(#43013686)
Depends on quantization selected - see https://www.canirunthisllm.net/