Re:Gemma 4 QAT models: Optimizing compression for mobile and...
by sowbug on Saturday June 06, 2026 @12:37PM
(#48426594)
Whatever you're doing, try doing 500 or 1,000 of it in a batch. You'll exhaust any subscription quota you have, or if you're paying per token, you will probably find it too expensive. That's when you'll start to ask "how smart a model do I really need for this job?", and you'll investigate running a small but sufficiently capable model on your own PC, churning overnight through your 1,000 tasks.
[ Parent
| on HN ]
There are no comments on this comment yet.