Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by dragonwriter on Sunday April 20, 2025 @05:36PM
(#43746696)
For model usability as a binary yes/no, pretty much the only dimension that matters is VRAM, and at 24GB the 3090 is still high end for a consumer NVidia GPUs, yes, the 5090 (and only the 5090) is above it, at 32GB, but 24GB is way ahead of the mid-range.
[ Parent
| on HN ]
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by NorwegianDude on Sunday April 20, 2025 @06:41PM
(#43747062)
24 GB of VRAM is a large amount of VRAM on a consumer GPU, that I totally agree with you on. But it's definitely not an extremely high end GPU these days. It is suitable, yes, but not high end. The high end alternative for a consumer GPU would be the RTX 5090, but that is only available for €3000 now, while used 3090s are around €650.