News for hackers. Stuff that matters.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by terhechte on Sunday April 20, 2025 @12:12PM (#43744683)
Local models, due to their size more than big cloud models, favor popular languages rather than more niche ones. They work fantastic for JavaScript, Python, Bash but much worse at less popular things like Clojure, Nim or Haskell. Powershell is probably on the less popular side compared to Js or Bash.

If this is your main use case you can always try to fine tune a model. I maintain a small llm bench of different programming languages and the performance difference between say Python and Rust on some smaller models is up to 70%

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by perching_aix on Sunday April 20, 2025 @12:27PM (#43744769)
How accessible and viable is model fine-tuning? I'm not in the loop at all unfortunately.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by terhechte on Monday April 21, 2025 @10:39AM (#43752517)
This is a very accessible way of playing around with the topic: https://transformerlab.ai