Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by perching_aix on Sunday April 20, 2025 @12:27PM
(#43744769)
How accessible and viable is model fine-tuning? I'm not in the loop at all unfortunately.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by terhechte on Monday April 21, 2025 @10:39AM
(#43752517)
This is a very accessible way of playing around with the topic:
https://transformerlab.ai
If this is your main use case you can always try to fine tune a model. I maintain a small llm bench of different programming languages and the performance difference between say Python and Rust on some smaller models is up to 70%