News for hackers. Stuff that matters.

A comment on Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac.

Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by n4pw01f on Wednesday July 29, 2026 @06:33PM (#49103963)
Are you running bare metal or docker? I had to go down to 2 bit on Gemma4 E2B model to run on 8gb on a Jetson

Quality and idempotency is great but it’s still not exactly fast… fast enough and works offline

Is this something that you can get running on Debian?

[ Parent | on HN ]
Re:Show HN: Open-source engine running Gemma 4 26B in 2 GB R... by gitpusher42 on Wednesday July 29, 2026 @06:51PM (#49104121)
It is Apple platform only implementation because of Metal (and Swift). Other platforms would require CUDA or Vulkan and a complete rework
[ Parent | on HN ]