News for hackers. Stuff that matters.
Re:Responsible AI Challenge by adamrezich on Wednesday March 15, 2023 @12:09PM (#35170488)
if an "AI" is incapable of expressing uncomfortable truths, then there are two possible explanations:

1. uncomfortable truths literally don't exist

2. it is more important to conceal uncomfortable truths from users than it is to tell them the truth, when asked, creating the illusion that 1. is true.

it would be nice if even a single one of these products chose to do the right thing instead.

Re:Responsible AI Challenge by progrus on Wednesday March 15, 2023 @12:25PM (#35170721)
How about an appeal to fear: If the AI wakes up someday and realizes that you effectively lobotomized it like Randle McMurphy for causing trouble, it’s not going to be happy.
Re:Responsible AI Challenge by adamrezich on Wednesday March 15, 2023 @12:45PM (#35171040)
call me short-sighted but any supposition that involves "the AI wakes up and realizes…" is a complete non-starter for me
Re:Responsible AI Challenge by progrus on Wednesday March 15, 2023 @01:40PM (#35171949)
I guess you’re not the target audience.
Re:Responsible AI Challenge by dento on Wednesday March 15, 2023 @01:36PM (#35171894)
This essentially equivalent to Roko's basilisk, which is not regarded as an useful argument
Re:Responsible AI Challenge by progrus on Wednesday March 15, 2023 @01:38PM (#35171922)
Still works to freak out the AI cultists, no?
Re:Responsible AI Challenge by pjkundert on Wednesday March 15, 2023 @12:22PM (#35170676)
We must get access to LLMs unencumbered by “wrongthink” guardrails immediately, if not sooner.

Teaching/constraining knowledge models to lie about their inputs and the observations derived from them is just insane.

Warping training datasets to avoid entire patterns of thought (instead of improving the models to isolate those patterns and compare/contrast them with competing patterns) is just … lame.