malim13
Re:Ask HN: What hardware are you using to run local LLMs?
on Monday November 02, 2026 @01:16PM (#50341088)
what model can you run with those?
Re:Ask HN: What hardware are you using to run local LLMs?
on Monday November 02, 2026 @01:06PM (#50340918)
I'm running a local LLM on my system below. It's alright, free intelligence for simple daily tasks. I still have opus sub for deep intelligence applications.
Local LLM loaded: Qwen 3.8 27B (qwen3.8:27b), served through Ollama.
MY SYSTEM: ASUS ROG MAXIMUS XI HERO Motherboard Intel® Core™ i9-9900K × 16 64GB DDR5 RAM RTX 3090 with 24GB VRAM