Re:Unsloth Dynamic 3.0 GGUFs
by charcircuit on Wednesday August 19, 2026 @04:28PM
(#49366794)
Of course. Models don't actually require VRAM. Nor do they require regular RAM. You could have 1 GB of RAM and swap the model to disk as you need different parts of it. And if you didn't have enough disks you could access weights via a network connection.
[ Parent
| on HN ]
Re:Unsloth Dynamic 3.0 GGUFs
by leoooodias on Wednesday August 19, 2026 @04:50PM
(#49367060)
You don’t even need electricity. You could print the model weights onto millions of sheets of paper, and hire a team of carrier pigeons to fly them into your office one by one. No VRAM!
Re:Unsloth Dynamic 3.0 GGUFs
by BonerWiener on Wednesday August 19, 2026 @05:05PM
(#49367200)
IP over Avian Carriers: https://www.rfc-editor.org/info/rfc2549/
Re:Unsloth Dynamic 3.0 GGUFs
by chuckadams on Wednesday August 19, 2026 @06:13PM
(#49367876)
Coincidentally that’s also Google’s new method for distributing Android sources.
Re:Unsloth Dynamic 3.0 GGUFs
by revolvingthrow on Wednesday August 19, 2026 @04:59PM
(#49367150)
The bitrot would be excessive
Re:Unsloth Dynamic 3.0 GGUFs
by kQq9oHeAz6wLLS on Wednesday August 19, 2026 @11:13PM
(#49369961)
The key to running in lower amounts of VRAM is patience. It'll be slow, but it'll work.