News for hackers. Stuff that matters.
Re:Everything you need to survive and rebuild society by 1d22a on Friday November 20, 2026 @12:32AM (#50570543)
Interesting. Is that just for inference or does that also amortise the energy used to train the model across the expected number of tokens served over its useful lifetime?
Re:Everything you need to survive and rebuild society by YetAnotherNick on Friday November 20, 2026 @01:03AM (#50570744)
For inference. For models like deepseek, training energy would be tiny compared to inference. But that's not including all experiments etc.