News for hackers. Stuff that matters.

A comment on Gemma 3 QAT Models: Bringing AI to Consumer GPUs. Parent comment

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by starik36 on Sunday April 20, 2025 @06:59PM (#43747164)
On an A5000 with 24GB, this model typically gets between 20 to 25 tps.
[ Parent | on HN ]

There are no comments on this comment yet.