News for hackers. Stuff that matters.
Re:GPT-3 fails horribly, then I coax it into figuring out ho... by riggsdk on Sunday July 10, 2022 @08:23AM (#32044045)
Somewhere in the training data there could have been information about how to do this but the model just didn't have a "connection" to that data until sufficient context was established. It wasn't until the end that the human asked about how to fake free phone calls at which point it might finally access what it knew from the training data, combining it with the context data in the chat transcript to give the answer.

I suppose there is a small similarity of how we learn a lot of things in school only to forget them almost entirely again - but when we are presented with a problem that requires that knowledge we can quickly deduce that knowledge or know what to do to regain that knowledge a lot quicker than by learning from scratch.

[dead]
Re:GPT-3 fails horribly, then I coax it into figuring out ho... by riggsdk on Sunday July 10, 2022 @02:58PM (#32047756)
I was merely speculating, I thought that was obvious. You calling me "mentally challenged" is uncalled for.
Re:GPT-3 fails horribly, then I coax it into figuring out ho... by deltaonenine on Sunday July 10, 2022 @03:15PM (#32047944)
No no. You made a mistake. I'm not calling you that at all. I'm saying the description of the ai, when replaced with more humanized terms sounds like a description of a slowish human being in terms of mental capacity. This is still compelling imo.

Not calling you mentally challenged at all.