Re:Watermark Anything
by pierrefdz on Wednesday November 13, 2024 @05:51PM
(#42131104)
The amounts of gpu time in the paper are for all experiments, not just training the last model that is OSS (which is usually reported). People don't just oneshot the final model.
Llama 3 70B took 6.4M GPU hours to train, emitting 1900 tons of CO2 equivalent.