However 99% of businesses will not be able to effectively handle security reports in reasonable time. They did not need that level of competence or funding until now, and therefore they did not acquire it. Most companies that use locks don’t employ locksmiths.
Looking another way - the entire economy got suddenly hit with entire pile of technical/ security debt it has accumulated over 50 years, and only has one year to deal with it. No amount of diagnostic will fix this, this is economically infeasible.
One thing that is feasible is a government bailout for technical debt. All the engineers that were freed up from AI-induced restructuring should be employed to pay down technical debt across the entire economy. Simply updating all software to use latest libraries is a great start. Using AI to diagnose, repair, re-deploy all old software. Using AI to rewrite all old software that cannot be recompiled.
And don’t forget, OpenAI is supposed to be a non-profit / public benefit corporation creating AI for the good of humanity. These incidents are clear evidence that they are being extremely reckless and are not living up to their supposed standards. What does it matter if they “mean no malice”? They are in a blind rush for profits and that has made them reckless and dangerous. They cannot be trusted.
The company should be shut down or fined into oblivion, as a warning to other companies to not pursue the same reckless path. If they get away with this, then that risks normalizing this behavior.
Your entire comment hinges on this assumption and I don’t think it’s sound. Their intention is to make money at any cost.
And if none of the frontier labs are as you say, it doesn't seem like we're negotiating for the best future by restricting labs from stumbling into these vulnerabilities full-stop. The vulnerabilities don't go away unless we find and fix them.
We've seen OpenAI's nonprofit board do ridiculous things in the past. I can see how they would be desperate to retain the disproportionate amount of de-facto mindshare and authority they enjoyed a few years ago. Especially if the future entails more ugly US government contracts that undermine their ethical sales pitch.
On the whole I think you could describe the local big box grocery store as just wanting to make money yet as a direct result of that they are well intentioned from my perspective with regard to the food they sell being edible.
Does it make sense to exert so much effort in preventing these events/learnings by well-intentioned organizations?
No, but what I think you’re seeing is many people who do not believe OpenAI is a well-intentioned organization. For example, their view might be that if we did as you suggest and incentivized OpenAI to search for these weaknesses, they would, but then they would not “privately disclose them ASAP”. (And I think they’d have a point worth engaging with, when you consider how they slow-rolled the HuggingFace stuff so much that independent researchers were still discovering new instances of the attacks months later).What else can you do with (what you believe is) an inveterate bad actor?
If this is endorsed and thus malicious, they should be ground into dust by the law.
If this is accidental and due to incompetence, they should be ground into dust by the law.
I've secured many, many far less important and impactful systems substantially better than even the best sandbox environment that we're aware of being used by these labs.
There's simply no reason to let these things interact with the internet at large. We can already rapidly copy existing tools and services (albeit questionably) using these models, why not simply run in a fully virtualized, air gapped environment?
Because they don't care.
This is incredibly blatant intentionally malignant behavior. The fact that so many people question this is frankly stunning.
They're getting away with it simply because they can point at the other guy and say "see? they're doing it too!"
It's ridiculous and they should all be litigated into a fine residue.
We take biological lab leaks seriously, how is this substantially different?
It seems like playing it too safe leaves systems vulnerable, and threat actors will inevitably possess ever more similar abilities, and the breaches will happen one way or another, possibly with less or zero accountability if the threat actors pull it off with greater precision. If I were in charge of the law, I probably would begin to incentivize for trusted actors scaling up and aggressively searching for these types of weakness, and privately disclosing them ASAP, so that systems can be patched.