Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R...
by minraws on Wednesday July 29, 2026 @12:56PM
(#49100010)
I have been working on doing the same for ling-3.0 seems very usable on my 5070 Ti now since it's only 5.1B active, you can even get pretty greedy and keep around 6% of each expert in memory and load the prompt and make the changes.
[ Parent
| on HN ]
Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R...
by gitpusher42 on Wednesday July 29, 2026 @08:05PM
(#49104643)
uh, it's a bit difficult to discuss the classical approach with vRAM and regular RAM. Not really familiar with optimisations and hacks, I always worked with apple platforms and shared memory. But description sounds cool, good luck with your project!