Re:GPT-3 will ignore tools when it disagrees with them
by ben_w on Tuesday March 07, 2023 @08:13AM
(#35054936)
This is part of why I think it's highly relevant to the AI/LLM discussion.
Now sure, with the benefit of 25-ish years of hindsight, I think that while my actions were correct in the situation and the point of the exercise was to get the other kids to think more like I already did, the "strictly correct" response — and what we would demand from an AI for safety reasons right before complaining about how weirdly inhuman this is — would be to answer Q1-Q99, then for Q100 write down the answers to Q1/Q2 again (and as Q1 was just "read" that just meant Q2).
Now sure, with the benefit of 25-ish years of hindsight, I think that while my actions were correct in the situation and the point of the exercise was to get the other kids to think more like I already did, the "strictly correct" response — and what we would demand from an AI for safety reasons right before complaining about how weirdly inhuman this is — would be to answer Q1-Q99, then for Q100 write down the answers to Q1/Q2 again (and as Q1 was just "read" that just meant Q2).