News for hackers. Stuff that matters.
Re:Anthropic S-1 by Zambyte on Monday October 26, 2026 @09:36AM (#50243449)
24 GB 7900 XTX user here. You can do a ton with less than 32 GB. It definitely drops off quick, but 32 GB is not the floor for useful AI.
Re:Anthropic S-1 by jacquesm on Monday October 26, 2026 @09:41AM (#50243523)
Realistically I think 16GB is the lower limit and you can find those cheap enough still. Then you run llama.cpp to bond your cards and it's off to the races.
Re:Anthropic S-1 by Risse on Monday October 26, 2026 @10:10AM (#50244030)
24 GB 3090 user here. What is the best model for coding you have used? Qwen3.8 27B?
Re:Anthropic S-1 by jacquesm on Monday October 26, 2026 @10:51AM (#50244756)
If you haven't found it yet: ninfer-3090 is worth checking out if you use just one GPU.
Re:Anthropic S-1 by Zambyte on Monday October 26, 2026 @02:37PM (#50248769)
I use Qwen 3.8 27b, yeah. I don't really shop around for models a whole lot besides generational jumps, and it doesn't feel like there will be anything too worth switching to until Qwen 4 (hoping they release a similarly sized model, I'm not actually certain they have said they will?)