Also maybe consider what this kind of visceral reaction indicates on a personal level :/
Yes, of course, it's all hype and not at all a really fucking concerning thing happening in cybersecurity. Totally wouldn't enable actors that wouldn't be able to hire top of the line hackers normally to cause chaos. Totally wouldn't cause old poorly maintained systems to start crawling with exploitable bugs at an ever-greater rate. Wouldn't affect "open source/closed source software" security dynamics in weird and hard to predict ways.
And, of course, the only reason for a company like Anthropic to bring it to attention is: marketing! Because it's not something that should get a "brace for impact" otherwise! Because trying to figure out whether you're about to fuck up something major in advance is only something that's ever done by UTTER FOOLS and MARKETING PEOPLE!
I am tired.
But you have to admit it does serve a savvy business purpose of creating a moat where one wasn’t by getting these tech companies on board and the threat does make for good marketing yeah?
There is NO shadow wizard marketing gang pulling the strings on every single thing those companies do! Ridiculous, right? But it's true.
Nonetheless, every time an AI company drops a "mechanistic interpretability" paper, or an "extreme AI behavior" paper, or a "concerning capability" report, or says something sensible like "we don't actually know if those systems are conscious or capable of suffering in any meaningful way", or does just about anything really? There's an entire horde of people shouting "it's MARKETING it's HYPE" materializing out of nowhere and drowning entire comment sections in this thought-substituting bullshit.
Yes there is they are called marketing departments and it is their exact purpose.
The Claude Code leak revealed that Anthropic runs Claude-operated bots on the internet. One should be very cautious in getting swept up in the fund-raising process if they are not seeing first-hand the fruition of all of the flattering claims being presented by strangers on the internet.
There's a pretty big difference between "We predict in X time frame our model will be capable of Y" and "Our model did Y."
This is like watching someone measure the size of an object and saying "I don't believe you because you guessed it was X before you pulled out your tape measure."