News for hackers. Stuff that matters.
Re:Unsloth Dynamic 3.0 GGUFs by charcircuit on Wednesday August 19, 2026 @04:28PM (#49366794)
Of course. Models don't actually require VRAM. Nor do they require regular RAM. You could have 1 GB of RAM and swap the model to disk as you need different parts of it. And if you didn't have enough disks you could access weights via a network connection.
Re:Unsloth Dynamic 3.0 GGUFs by leoooodias on Wednesday August 19, 2026 @04:50PM (#49367060)
You don’t even need electricity. You could print the model weights onto millions of sheets of paper, and hire a team of carrier pigeons to fly them into your office one by one. No VRAM!
Re:Unsloth Dynamic 3.0 GGUFs by BonerWiener on Wednesday August 19, 2026 @05:05PM (#49367200)
Re:Unsloth Dynamic 3.0 GGUFs by chuckadams on Wednesday August 19, 2026 @06:13PM (#49367876)
Coincidentally that’s also Google’s new method for distributing Android sources.
Re:Unsloth Dynamic 3.0 GGUFs by revolvingthrow on Wednesday August 19, 2026 @04:59PM (#49367150)
The bitrot would be excessive
Re:Unsloth Dynamic 3.0 GGUFs by kQq9oHeAz6wLLS on Wednesday August 19, 2026 @11:13PM (#49369961)
The key to running in lower amounts of VRAM is patience. It'll be slow, but it'll work.