For me I see ERNIE as BERT's long time friend and room mate.
It's a homage to BERT (Bidirectional Encoder Representations from Transformers), Google's influential 2018 Transformer model that wasn't autoregressive. https://arxiv.org/abs/1810.04805v2
https://en.wikipedia.org/wiki/Premium_Bonds#ERNIE