Re:Stanford Alpaca: An Instruction-following LLaMA model
by ben_w on Monday March 13, 2023 @03:36PM
(#35141243)
If your takeaway from…
> Importantly, we have not yet fine-tuned the Alpaca model to be safe and harmless.
…is "oh no I can't get it to emit amusing racial and sexual slurs", you've not understood the problem of AI safety.
This is not why US broadcast television can have people say they've pricked their finger but not vice versa.
It is the entire history of all the controversies of The Anarchist Cookbook, combined with all the controversies about quack medicine, including all the ones where the advocates firmly believed their BS like my mum's faith in Bach flower and homeopathic remedies[0]; combined with all the problems of idiots blindly piping the output to `exec`, or writing code with it that they trust because they don't have any senior devs around to sanity check it because devs are expensive, or the same but contracts and lawyers…
And that's ignoring any malicious uses, though fortunately for all of us this is presently somewhat too expensive to be a fully-personalised cyber-Goebbels for each and every sadistic machiavellian sociopath that hates you (the reader) personally.
[0] which she took regularly for memory; she got Alzheimer's 15 years younger than her mother who never once showed me any such belief.
> Importantly, we have not yet fine-tuned the Alpaca model to be safe and harmless.
…is "oh no I can't get it to emit amusing racial and sexual slurs", you've not understood the problem of AI safety.
This is not why US broadcast television can have people say they've pricked their finger but not vice versa.
It is the entire history of all the controversies of The Anarchist Cookbook, combined with all the controversies about quack medicine, including all the ones where the advocates firmly believed their BS like my mum's faith in Bach flower and homeopathic remedies[0]; combined with all the problems of idiots blindly piping the output to `exec`, or writing code with it that they trust because they don't have any senior devs around to sanity check it because devs are expensive, or the same but contracts and lawyers…
And that's ignoring any malicious uses, though fortunately for all of us this is presently somewhat too expensive to be a fully-personalised cyber-Goebbels for each and every sadistic machiavellian sociopath that hates you (the reader) personally.
[0] which she took regularly for memory; she got Alzheimer's 15 years younger than her mother who never once showed me any such belief.