News for hackers. Stuff that matters.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by GaunterODimm on Sunday April 20, 2025 @01:55PM (#43745299)
2days :/...
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by rob_c on Sunday April 20, 2025 @02:09PM (#43745387)
Given I know people running gemma3 on local devices for over almost a month now this is either a very slow news day or evidence of finger missing the pulse... https://blog.google/technology/developers/gemma-3/
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by simonw on Sunday April 20, 2025 @02:17PM (#43745443)
This is new. These are new QAT (Quantization-Aware Training) models released by the Gemma team.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by rob_c on Sunday April 20, 2025 @02:25PM (#43745501)
There's nothing more than an iteration on the topic, gemma3 was smashing local results a month ago and made no waves as it dropped...
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by simonw on Sunday April 20, 2025 @02:29PM (#43745530)
Quoting the linked story:

> Last month, we launched Gemma 3, our latest generation of open models. Delivering state-of-the-art performance, Gemma 3 quickly established itself as a leading model capable of running on a single high-end GPU like the NVIDIA H100 using its native BFloat16 (BF16) precision.

> To make Gemma 3 even more accessible, we are announcing new versions optimized with Quantization-Aware Training (QAT) that dramatically reduces memory requirements while maintaining high quality.

The thing that's new, and that is clearly resonating with people, is the "To make Gemma 3 even more accessible..." bit.

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by rob_c on Sunday April 20, 2025 @02:37PM (#43745596)
As I've said in my lectures on how to perform 1bit training of QAT systems to build classifiers...

"An iteration on a theme".

Once the network design is proven to work yes it's an impressive technical achievement, but as I've said given I've known people in multiple research institutes and companies using Gemma3 for a month mostly saying they're surprised it's not getting noticed... This is just enabling more users but the none QAT version will almost always perform better...

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by simonw on Sunday April 20, 2025 @02:45PM (#43745652)
Sounds like you're excited to see Gemma 3 get the recognition it deserves on Hacker News then.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by rob_c on Sunday April 20, 2025 @02:48PM (#43745675)
No just pointing out the flooding obvious as usual and collecting down votes for it
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by fragmede on Sunday April 20, 2025 @04:31PM (#43746331)
Speaking for myself, my downvotes are not because of the content of your arguments, but because your tone is consistently condescending and dismissive. Comments like “just pointing out the flooding obvious” come off as smug and combative rather than constructive.

HN works best when people engage in good faith, stay curious, and try to move the conversation forward. That kind of tone — even when technically accurate — discourages others from participating and derails meaningful discussion.

If you’re getting downvotes regularly, maybe it's worth considering how your comments are landing with others, not just whether they’re “right.”

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by rob_c on Sunday April 20, 2025 @11:31PM (#43748316)
My tone only switches once people get uppity. The original comment is on point and accurate, not combative and not insulting (unless the community seriously takes a 'lol'....

Tbh I give up writing that in response to this rant. My polite poke holds and it's non insulting so I'm not going to capitulate to those childish enough to not look inwards.