News for hackers. Stuff that matters.
Re:Teaching GPT-3 to Identify Nonsense by skybrian on Wednesday July 29, 2020 @08:06PM (#23992935)
It can make up reasons just like it can make up answers. That doesn't mean they are the real reasons.

Then again, people do the same.

Since it's autocomplete, asking for the reasoning first makes it likely that the reasoning is used to calculate the answer. It would be interesting to see how accuracy changes when they are in the opposite order, and the reasoning is a post-hoc justification of the previously given answer.

You could also change the answer and see what the new post-hoc justification looks like.

Re:Teaching GPT-3 to Identify Nonsense by IggleSniggle on Wednesday July 29, 2020 @08:53PM (#23993222)
Yeah exactly people do the same thing. There's good evidence that for the most part, our actions are driven by our "non-sentient" mind, and our sentient brain just decides justifications to explain a cohesive story as it goes along after it happens.

"Why did you do that?" -> attempt to make up an answer that will be believable both to self-identity and to the listener.

So what's the point of the executive mind if the hindbrain is doing all the walking and talking?

The primary benefit of this story-making is that it allows formulating predictions and discarding the least probable. When a believable prediction kicks in, the predictive brain incentivizes the hindbrain with a partial taste of any reward or pain, with promises of more should the path transpire.

Disclaimer: not a neuroscientist, just a lifelong enthusiast of the subject.

Re:Teaching GPT-3 to Identify Nonsense by ZephyrBlu on Wednesday July 29, 2020 @08:59PM (#23993253)
This is very believable. Post-rationalization just makes sense. Even if you come up with a shitty reason, at least you have _a_ reason for doing something.
Re:Teaching GPT-3 to Identify Nonsense by inakarmacoma on Thursday July 30, 2020 @12:39AM (#23994736)
Your comment is an example of itself.
Re:Teaching GPT-3 to Identify Nonsense by red75prime on Thursday July 30, 2020 @11:55PM (#24005488)
Situations, where you don't make cohesive story, but stop and think "What the hell I'm doing?", aren't uncommon either.