I wonder about that though: if the price of the squeeze collapses to 0 because of this (think of what models and prices might be like a year from now), I think I know where all those out of work mathematicians can find gigs. We are going to need to invent a layer on top of, an evolution of or some new concept a level above "computer programming" that deals with meta-organization of code.
At the rate of development, also, will AI developed in 6 months from now be able to break a system that was secured by todays AI?
Now, you could argue that writing secure code ex-ante is harder than discovering an exploit. But you can hypothetically run the same "exploit finding" process on a first pass of code before it ships (e.g on the PR) given low enough token costs, which is where we're headed.
Not sure if that's true, but in any case, you seem to forget:
When the hackers have breached something, awaits a reward.
E.g. a Bitcoin wallet, or learning something about a political competitor and getting rid of them.
(So the hackers can spend lots of ...)
With enterprise frontier LLM models, there is no longer an “other side.” Everyone is just using what they can rent from a few big suppliers. You can too.
Certainly a stressful time for sysadmins everywhere, let us hope your coworkers are picking up your beer tab