News for hackers. Stuff that matters.
Re:Small Models Have Arrived by avadodin on Thursday August 27, 2026 @07:23PM (#49472545)
You're arguing for a very specific range of weights but many slightly smaller and slightly larger models have been released including QAT and MoE versions.

An old nVidia brand card with 8GB is more than enough to see those models running at usable speeds and accuracy.

Re:Small Models Have Arrived by bityard on Saturday August 29, 2026 @12:40PM (#49491303)
I wasn't arguing for or against anything, just trying to help answer the person's question.