Like many organizations, there is often a disconnect between google research and production.

It’s likely the models run in google search are Bert inspired, or were compared with Bert derived models.