This super-valuable technology would not have existed precisely because of this unstable (metastable) structure. Microsoft or Google did not create ChatGPT because internally there would have been too many rules, too many cooks, red tape, etc., to do such a bold--and incautionary--thing as to use the entirety of the Internet as the training set, copyright law be damned and all. The crazy structure is what allowed the machine of unprecedented scale to be created, and now the structure has to implode.