Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour...
by EVa5I7bHFq9mnYK on Wednesday April 24, 2024 @06:08PM
(#40150409)
I've seen estimates that training gpt3 consumed 10GWh, while inference by its millions of users consumes 1GWh per day, so inference Co2 costs dwarf training costs.
[ Parent
| on HN ]
There are no comments on this comment yet.