News for hackers. Stuff that matters.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by EVa5I7bHFq9mnYK on Wednesday April 24, 2024 @06:08PM (#40150409)
I've seen estimates that training gpt3 consumed 10GWh, while inference by its millions of users consumes 1GWh per day, so inference Co2 costs dwarf training costs.

There are no comments on this comment yet.