News for hackers. Stuff that matters.
Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by parched99 on Sunday April 20, 2025 @11:52AM (#43744568)
I think Powershell is a bad test. I've noticed all local models have trouble providing accurate responses to Powershell-related prompts. Strangely, even Microsoft's model, Phi 4, is bad at answering these questions without careful prompting. Though, MS can't even provide accurate PS docs.

My best guess is that there's not enough discussion/development related to Powershell in training data.

Re:Gemma 3 QAT Models: Bringing AI to Consumer GPUs by fragmede on Sunday April 20, 2025 @04:18PM (#43746262)
Which, like, you'd think Microsoft has an entire team there who's purpose would be to generate good PowerShell for it to train on.