News for hackers. Stuff that matters.

A comment on Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency. Parent comment

Re:Gemma 4 QAT models: Optimizing compression for mobile and... by steno132 on Friday June 05, 2026 @04:45PM (#48418003)
Practically if you're running a small personal automation project you're not going to want to waste a lot of time configuring and tuning a local model. You want to build the automation and move on.

If you're building a automation as a company you definitely won't want to take on the long term maintenance overhead of running your own models for some automation project.

[ Parent | on HN ]
Re:Gemma 4 QAT models: Optimizing compression for mobile and... by adam_arthur on Friday June 05, 2026 @04:45PM (#48418015)
These small models exist in the cloud and are/will be priced commensurately to their size.

Your claim is effectively that companies don't care about operational/cloud costs. Even pre-LLM, companies regularly assessed and tried to pare down cloud spend.

[ Parent | on HN ]