>This looks like they're not training the single big model but instead have gone off to develop special sub models and attempt to gloss over them with yet another model. That's what you resort to only when doing the end-to-end training has become too expensive for you.

The corollary to the bitter lesson strikes again: any hand crafted system will out perform any general system for the same budget by a wide margin.