There comes a point where you not only want the boy to stop crying wolf, but hopefully be eaten by one.
At this point we have enough of real evidence from project glasswing like the massive Firefox security patches from Mythos findings. This isn’t crying wolf.
I’m very glad that they’re actually being grownups and not yolo’ing something this important, and are working with groups until we can secure critical infrastructure before making this more available.
>OpenAI said its new natural language model, GPT-2, was trained to predict the next word in a sample of 40 gigabytes of internet text. The end result was the system generating text that “adapts to the style and content of the conditioning text,” allowing the user to “generate realistic and coherent continuations about a topic of their choosing.” The model is a vast improvement on the first version by producing longer text with greater coherence.
>But with every good application of the system, such as bots capable of better dialog and better speech recognition, the non-profit found several more, like generating fake news, impersonating people, or automating abusive or spam comments on social media.
Actually, the biggest problem is the automation of inane comments on X. Which is admittedly quite surprising - I would have agreed with OpenAI at the time.
Guinness didn't want to make it public because he was afraid competition would start using it, and then lose his company's advantage.
In the current context, the retention didn't happen because of Anthropic. On the contrary, the company wanted to offer Mythos/Fable.
That one will be fun to see.
this doesn't mean it cannot leak but it would be a major undertaking.
this is why anthropic isn't that worried about having Elon service their models. the workflow would be something like handshaking with the nvidia TEE, provisioning it with your keys and then uploading encrypted weights. there is probably also a timer in there so you can't continue operating the nvidia box with the stolen weights without a heartbeat signal.
(obviously not serious, but it's fun to probe what we can actually reason about when every message might be adversarial)
as for reverse engineering I doubt it's something that state sponsored actors would struggle with for too long.
We all need cyborg cats to hunt cyborg mice. There's no other compromise unless you want a rat infestation.
The difficulty of the task and human performance on that task hasn't changed. LLMs performance on that task has changed dramatically.
its in the training data, probably many times, and it was then, too
As the generations increase, so too has the complexity of the games it can one-shot.
I'm still waiting for any evidence of LLM economic impact in the real world.
Those demos are put out by non-engineer AI-bros who start from a blank slate and just test raw one-shot performance of the model.
In comparison I'm aware of how much additional performance you can extract out of models with a team of professional engineers that are balls-deep in harness engineering.
That delta is very large.
It's exciting.
I mean, if the matryoshka doll rent-a-gpu farce that is SpaceX somehow is worth $2T with their garbage child porn xAI, Anthropic must be worth quadzillions.
If fable is the best we got everybody still has some more time till the apocalypse I think.
Imagine this, fable weights are likely distributed to hundreds of datacenters with likely thousands of people directly or indirectly having partial or full access. I just don't quite buy that a 'world ending' fable/mythos model would be treated like this, mythos I could maybe believe that it runs inside government compliant datacenters which have a proven track record, but something as valuable as a 'world ending' model invites state sponsored actors to put in significantly more effort into exfiltrating it.
Whatever the real story is I doubt this is as ground-breaking as anthropic claims it to be.