Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse...
by nok22kon on Friday June 26, 2026 @05:40AM
(#48684484)
obviously depends on your location and GPU
for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this is excluding how much the GPU cost (no amortization)
ignoring the fact that I could get more free tokens per day for this model from Google/OpenRouter, it would cost $4 per day on OpenRouter if paid, but they would run it at full 16 bit precission
this would be the most "profitable" model for me
for Gemma4-31B I can generate only 1 mil tok per day, and so I pay more to get less quality than OpenRouter (ignoring that this model is also free on Google)
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse...
by s1artibartfast on Friday June 26, 2026 @12:55PM
(#48688904)
This is very interesting to me. How do you come up with the kwh/token for your setup?
Could you give an example with real figures?