News for hackers. Stuff that matters.
Re:Gemma 3 270M: The compact model for hyper-efficient AI by perching_aix on Thursday August 14, 2025 @03:36PM (#44904662)
Thanks, will check that out as well tomorrow or during the weekend!
Re:Gemma 3 270M: The compact model for hyper-efficient AI by canyon289 on Thursday August 14, 2025 @04:59PM (#44905632)
If you know you want JSON for sure constrained decoding in an inference framework will help. The model is just one part of an overall inference system. I hope this model paired with other tools help you get done whatever it is you're looking to get done