News for hackers. Stuff that matters.
Re:ALBERT: A Lite BERT for Self-Supervised Learning of Langu... by nl on Wednesday January 08, 2020 @08:02PM (#21997495)
They are comparing the speed to execute training to 125K steps, not speed to a given accuracy.

In section 4.8 they compare accuracy at the same amount of training time for the biggest of each model and show that ALBERT is substantially better.

There are no comments on this comment yet.