My understanding is that those building them don't really know how they work. Research into interoperability has fallen way behind as funding went towards features and scale.
Any understanding of how they work is largely theoretical, that seems like a reasonable place for academics to lean in and join the conversation.
It doesn't really make sense to trust what OpenAI and friends say about this either, when admitting to any kind of scaling limits would go against the narrative propping up their multi-hundred-billion-dollar valuations. I guess we're just flying blind for now.
If people at OpenAI, Anthropic, or Google said this, that would be interesting. But I don't think it makes sense any more to treat academic computer scientists as relevant experts here.