News for hackers. Stuff that matters.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by JumpCrisscross on Friday June 26, 2026 @05:19AM (#48684323)
> do the electricity math

Could you give an example with real figures?

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @05:40AM (#48684484)
obviously depends on your location and GPU

for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this is excluding how much the GPU cost (no amortization)

ignoring the fact that I could get more free tokens per day for this model from Google/OpenRouter, it would cost $4 per day on OpenRouter if paid, but they would run it at full 16 bit precission

this would be the most "profitable" model for me

for Gemma4-31B I can generate only 1 mil tok per day, and so I pay more to get less quality than OpenRouter (ignoring that this model is also free on Google)

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by s1artibartfast on Friday June 26, 2026 @12:55PM (#48688904)
This is very interesting to me. How do you come up with the kwh/token for your setup?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Saturday June 27, 2026 @04:47AM (#48696391)
I know how many tokens per second my computer generates, and I have a wall power meter which measures how many watts my computer is using when generating.