News for hackers. Stuff that matters.

A comment on Gemma 3 QAT Models: Bringing AI to Consumer GPUs. Parent comment

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by ygreif on Monday April 21, 2025 @11:20AM (#43752951)
Do many consumer GPUs have >20 gigabytes RAM? That sounds like a lot to me
[ Parent | on HN ]
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by mcintyre1994 on Monday April 21, 2025 @12:53PM (#43753979)
I don't think so, but Apple's unified memory architecture makes it a possibility for people with Macbook Pros.
[ Parent | on HN ]