Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by dragonwriter on Sunday April 20, 2025 @05:36PM
(#43746696)
For model usability as a binary yes/no, pretty much the only dimension that matters is VRAM, and at 24GB the 3090 is still high end for a consumer NVidia GPUs, yes, the 5090 (and only the 5090) is above it, at 32GB, but 24GB is way ahead of the mid-range.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by NorwegianDude on Sunday April 20, 2025 @06:41PM
(#43747062)
24 GB of VRAM is a large amount of VRAM on a consumer GPU, that I totally agree with you on. But it's definitely not an extremely high end GPU these days. It is suitable, yes, but not high end. The high end alternative for a consumer GPU would be the RTX 5090, but that is only available for €3000 now, while used 3090s are around €650.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by zapnuk on Sunday April 20, 2025 @05:31PM
(#43746662)
A 3090 still costs 1800€. Thats not mid-range by a long shot
The 5070 or 5070ti are mid range. They cost 650/900€.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by sentimentscan on Sunday April 20, 2025 @07:24PM
(#43747297)
A year ago, I bought a brand-new EVGA hybrid-cooled 3090 Ti for 700 euros. I'm still astonished at how good of a decision it was, especially considering the scarcity of 24GB cards available for a similar price. For pure gaming, many cards perform better, but they mostly come with 12 to 16GB of VRAM.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by NorwegianDude on Sunday April 20, 2025 @06:27PM
(#43746973)
3090s are no longer produced, that's why new ones are so expensive. At least here, used 3090s are around €650, and a RTX 5070 is around €625.
It's definitely not extremely high end any more, the price is(at least here) the same as the new mid range consumer cards.
I guess the price can vary by location, but €1800 for a 3090 is crazy, that's more than the new price in 2020.
The high end consumer card from Nvidia is the RTX 5090, and the professional version of the card is the RTX PRO 6000.