While the transformer model is important that was 1 paper in an ocean they put out every year.

Also it’s one of the only papers they put out that falls completely outside what I put above. They released everything about it including the model code, pretrained weights, the techniques; and it took quite a while for the model to “catch on” while it was peer reviewed and reproduced by others.

Something something broken clock