Like gain of function research
Their practical utility would plummet for the average person who isn't an expert in what they're asking. Having less skilled, or less attentive, people able to have problems solved for them is the primary use case here.
Most of the global memories I have to to encourage pushback and NOT do exactly what I saw. I want an intelligent assistant, not a "yes man".
> Their practical utility would plummet for the average person who isn't an expert in what they're asking. Having less skilled, or less attentive, people able to have problems solved for them correctly is the primary use case here. This is support 101 for unskilled requests for technical work: do what they want, not what they ask.
That's actually good for society. Maybe it sucks for you because it makes it harder to do what you want right now, but it's good to have humans very much in the loop and in control. Both to give people something valuable to do, and keep control of these machines.
They should be tools (amplify human skill), not replacements (eliminate the need for human skill).
- if you ask an LLM agent to do something illegal for you, and it does that, then you are responsible.
- if an LLM agent takes actions out of bounds of what you asked for that are illegal, then the model provider is responsible.
This fixes all “alignment” issues and hopefully stops Anthropic’s stupid model instructions like “do whatever is in your best interest even if it isn’t what the user asked for” — they should be training them to do exactly what the user asks and nothing more