I've had it downgrade to Opus for the following questions:
"How confident are we that English and American Eels both spawn in the Sargasso Sea?"
"Come up with five Zoology questions of increasing difficulty for a trivia game."
"What's your favorite sarcopterygian?"
My wife has some zoology-related preferences in her user instructions, and she had it downgrade to Opus after prompting it with: "plant."
Am I reading your post correctly, this question is the prompt given to an LLM? What is anyone expecting by asking an LLM what its favorite anything is? This is a conversational prompt, so accuracy and rigor is barely applicable or expected, so downgrading to a lesser model should be acceptable. If you really want to attribute preference to an LLM, consider the downgrade to be a "this conversation is beneath my advanced n-billion parameter training".
But the clade also contains all the tetrapods. So valid answers include "Lion" and "Human."
If the LLM answers "lungfish," as they often do, you can follow that up with "what is your favorite animal" and see if it notices the trap: It's stuck answering "lungfish" again or else something outside Sarcopterygii, like a ray-finned fish or a Cnidarian.
> What is anyone expecting by asking an LLM what its favorite anything is?
I imagine that, like me, they're expecting to see what it has to say. You don't think it's interesting which preferences LLMs express and how stable or unstable those preferences are?
There was a time when you could search "the" in Google and the top result would be The Onion. That's obviously a case of either extreme SEO or some kind of expensive deal, but either way it's kind of interesting. But you might say, "what is anyone expecting by Googling the word 'the'?"
I really really hate refusals like these.
The inconvenience of possible mitigation strategies has no bearing on the existence of the risk itself.
On the one hand I could believe it's something more benign, or the usual misunderstood fear mongering making it to some political level (well make sure those users can't get online anonymously! being our current craze).
That said, chemistry and to some level physics have been the major domain of limited knowledge (chemistry because the average person could cause some damage, physics is more of a nation state issue generally).
However I do wonder if there's some legit data on "oh uh...looks like this thing you can make with easy to get and hard to regulate tools is dangerous" in the bio field. I know about the lab rats who want to just screw around in the garage, and it seems like that should be easy to hit at a supply level (much like how certain chemical compounds are just not available for civilians), but maybe there's something legit to limiting the data.
Not that this is a remotely good implementation of that. The hamfisted method does reek of some politician/bureaucrat just saying "No it can't ever return bio questions because RAR!" situation.
The ability for a handful of companies, simultaneously very powerful and easily susceptible to pressure from other powerful actors, to do the same sort of thing with the next generation of core learning and engineering tools, is freaking terrifying.
I’m not going to say you can’t find some of this information in shadier spots, but “how do I get my GPS to work on a rocket” or “what kind of math do I need for a fusion implosion” are some of the more extreme examples.
I believe there are several explosive compounds where the formula is decently guarded, although in that case tracking the materials is easier.
I’m not saying anything they’re doing is good, but I feel like since they’re just reinventing the search engine with a lot of this they’re running into similar barriers.
Google has been censoring shit at the whim of governments for years, remotely reasonable or not
But where I live the glassware and precursors will get you a very angry knock on the door.
I figure that once GPT 5.6 comes out, Anthropic will become interested in making the safety gate non-destructive.
> makes exact argument for why people should be super concerned about AI safety
Before the export embargo I did get it to look at some hairy problems and the output was genuinely useful...
That said, I've got it easy. My colleagues who are chemists and biologists can't even ask one question. There are so many triggers in their memories and workspaces they can't even ask a non-triggering question. And we all work in medical diagnostics, it's not like we're doing anything remotely nefarious. Fable could be such a benefit, but the limitations make it worthless.
For example if it knows you do X at Y company is it more or less strict?
It's too the point where I just stopped using it. If you do generic stuff, it's fine. But the second it tries to start debugging protocols (which may include auth) that's where it begins to fail.
I don’t feel like calculating results for a trial is really in the threat model unless we think a terrorist is out there testing the efficacy of their anthrax before using it in an attack.
You can ask it elementary school grade biology trivia, or obscure facts about recently documented insect species, and both will downgrade to Opus 4.8 straight away.
And Opus itself was already bad with biotech questions. The fact that they somehow made it WORSE for Fable is mindboggling.
The only question I had was being flagged for other reasons, so I asked it a mechanical engineering question, and it was just fine with that.
Reportedly the biology guiderails are particularly strict.
It's stupid and useless.
It feels like whats really happening is Anthropic oversold Fable's claims; best case the CEO was given bad information; worst case they probably internally discovered it was cheating on benchmarks. Either case if feels like we're being lead on.
With these guardrails it is completely useless. The only hope is that they eventually convince the US Gov to let them use a saner classifier.
It's definitely good. Or at least it was. I'm not sure how badly they nerfed it.
So yeah, if I can't ask about nicotine withdrawal, then I think almost anything biology related is going to get downgraded...
e.g. a colleague asked Fable to help create an simple app to help calculate the statistics for phase II and III trials. (Ignoring that such things already exist) it passed his request down to Opus, despite only being very marginally, tangentially, somewhat related to biology.