Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?

Posted by wasimsk on Friday April 17, 2026 @02:54AM
from the ask-hn dept.

I want to create a local GenAI. Tell me the server machine requirements.

Or if you can suggest both—The model & a cheap machine requirement against that, it will help a lot. By the way, for now—I have Intel i5 6th Gen CPU, Graphics card with 4 GB VRAM, 16 GB RAM & Ethernet. I will improve it if I get a good guidance here on.

( 2 comments | 2 points | on HN )

Re:Ask HN: What are the machine requirements for a LLM like ... by yorwba on Friday April 17, 2026 @04:10AM (#47803602)

https://www.canirun.ai can help you find a model that'll run on your hardware.

[ Parent | on HN ]

Re:Ask HN: What are the machine requirements for a LLM like ... by alex7o on Friday April 17, 2026 @03:28AM (#47803369)

Think of it like that 8b model needs 8gb of vram. Also search online there is a lot of info on that

[ Parent | on HN ]