News for hackers. Stuff that matters.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by canyon289 on Thursday August 14, 2025 @03:00PM (#44904256)
32k context window so whatever fits in there. What is a finetune of mac system settings?
Re:Gemma 3 270M: The compact model for hyper-efficient AI by megaman821 on Thursday August 14, 2025 @03:31PM (#44904600)
The finetune would be an LLM where you say something like "my colors on the screen look to dark" and then it points you to Displays -> Brightness. It feels like a relatively constrained problem like finding the system setting that solves your problem is a good fit for a tiny LLM.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by canyon289 on Thursday August 14, 2025 @04:36PM (#44905398)
This would be a great experiment. I'm not sure how the OS integration would work, but as a first pass you could try finetuning the model to take natural language "my colors on the screen look to dark" and then have it output "Displays -> Brightness", then expand to the various other paths you would like the model to understand
Re:Gemma 3 270M: The compact model for hyper-efficient AI by gunalx on Friday August 15, 2025 @04:50AM (#44910038)
Maybe using a larger model to generate synthetic data of question path Combos, and also to rephrase and generate similar type questions for a more varier training set.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by hadlock on Thursday August 14, 2025 @07:33PM (#44906959)
It seems to dip into repeating itself pretty quickly on any task of actual complexity.