News for hackers. Stuff that matters.
Re:Does GPT-2 Know Your Phone Number? by jcims on Sunday December 27, 2020 @09:39AM (#25551304)
I was in a discord with someone that had direct access to GPT-3. We played Jeopardy with it, where we would take a wikipedia article about a person and use a snippet of the first paragraph as the prompt and ask GPT-3 who it was.

It was very good at guessing the right person.

I'm curious if one can use GPT-3 to do some clustering of people based on their writing. For example, if I take the writing of several diagnosed sociopaths as a prompt or fine tuning data, could I use GPT-3 to detect same in the wild?

I would imagine GPT-5 or 6 will start consuming video as well. This will be interesting if you start mixing the content from YouTube, TikTok, WSHH, etc. into the mix. So not only will it be able to generate text, it will generate a convincing video of a person speaking to you with plausible facial expressions and intonation in speech.

Re:Does GPT-2 Know Your Phone Number? by fakedang on Sunday December 27, 2020 @09:42AM (#25551324)
Guess it's because it was likely trained on Wikipedia data. After all, GPT-3 is no stranger to borrowing phraseology from verbose texts in the internet.
Re:Does GPT-2 Know Your Phone Number? by jcims on Sunday December 27, 2020 @09:47AM (#25551357)
That was our conclusion as well, but that's still pretty powerful. The remarkable part for me was that it contextually knew that we were asking for the name of the subject that the text was about.
Re:Does GPT-2 Know Your Phone Number? by aimor on Sunday December 27, 2020 @09:58AM (#25551438)
But did it respond in the form of a question?
Re:Does GPT-2 Know Your Phone Number? by anticensor on Sunday December 27, 2020 @02:15PM (#25553453)
GPT is generalisable to other kinds of data. See ImageGPT for example.
Re:Does GPT-2 Know Your Phone Number? by hooande on Sunday December 27, 2020 @11:55AM (#25552297)
The sociopath thing is just text classification, you could do that now without gpt-3. Video data would be significantly more difficult to model because it doesn't follow a simple set of rules like written language does