News for hackers. Stuff that matters.
Re:Google claims new AI training tech is 13x faster, 10x mor... by tetris11 on Monday July 08, 2024 @08:17AM (#40904731)
But more power still, yes?

10x more efficient power usage than what it would have been for a 13x faster/bigger model, but still more power usage for the new training tech than in the older revision.

Re:Google claims new AI training tech is 13x faster, 10x mor... by MattPalmer1086 on Monday July 08, 2024 @12:56PM (#40907081)
No, it says it is 13 times faster, and 10x more power efficient.

So you could train a model 10 times bigger for the same power usage (assuming it scales linearly), and it would be a bit faster to do that as well.

Or you could train a model 13 times bigger for the same speed, and use 10x less power than if you hadn't.