Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs
by parched99 on Sunday April 20, 2025 @11:52AM
(#43744568)
I think Powershell is a bad test. I've noticed all local models have trouble providing accurate responses to Powershell-related prompts. Strangely, even Microsoft's model, Phi 4, is bad at answering these questions without careful prompting. Though, MS can't even provide accurate PS docs.
My best guess is that there's not enough discussion/development related to Powershell in training data.
My best guess is that there's not enough discussion/development related to Powershell in training data.