News for hackers. Stuff that matters.
Re: by yeokm1 on Tuesday April 15, 2025 @09:32AM (#43692457)
Conventional wisdom states that running LLMs locally will require computers with high performance specifications especially GPUs with lots of VRAM. But is this actually true?

Thanks to an open-source llama2.c project, I ported it to work so vintage machines running DOS can actually inference Llama 2 LLM models. Of course there are severe limitations but the results will surprise you.

There are no comments on this comment yet.