There was an Information article a few weeks ago on Apple increasing its daily spend to millions of dollars in ML training costs per day. With their historic desire for control over the whole stack, I'd put money on them rolling their own architecture.