It's notable that during the cold war, test ban treaties didn't extend to underground detonations because there was no way to detect these detonations, and thus no way to enforce an agreement. This is an obvious problem for agreeing not to develop LLMs further.